File size: 140 Bytes
564d269
 
 
 
 
1
2
3
4
5
---
license: apache-2.0
---

This model is a fine-tuned version of Zephyr-7B using DPO on the HuggingFaceH4/ultrafeedback_binarized dataset.