Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
DUAL-GPO
/
zephyr-7b-ipo-10k-40k-0.001-i1
like
0
Follow
DUAL Group
2
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
main
zephyr-7b-ipo-10k-40k-0.001-i1
/
runs
Commit History
Training in progress, step 100
83fb512
verified
BraylonDash
commited on
Sep 23
Training in progress, step 60
cdc6c2b
verified
BraylonDash
commited on
Sep 23
Training in progress, step 20
dd307e6
verified
BraylonDash
commited on
Sep 23
Previous
1
2
Next