Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
DUAL-GPO
/
zephyr-7b-dpo-0k-15k-i1-merged
like
0
Follow
DUAL Group
2
PEFT
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Use this model
953c86e
zephyr-7b-dpo-0k-15k-i1-merged
Commit History
Create README.md
953c86e
verified
lole25
commited on
Sep 20
Upload tokenizer
c07d473
verified
BraylonDash
commited on
Sep 19
Upload MistralForCausalLM
634773f
verified
BraylonDash
commited on
Sep 19
initial commit
ade2316
verified
BraylonDash
commited on
Sep 19