Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
DUAL-GPO
/
zephyr-7b-gpo-v1-i2
like
0
Follow
DUAL Group
2
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
208df45
zephyr-7b-gpo-v1-i2
/
adapter_config.json
Commit History
Training in progress, step 1900
54e1900
verified
lole25
commited on
May 11
Training in progress, step 600
7681d45
verified
lole25
commited on
May 11
Training in progress, step 1400
64d606b
verified
lole25
commited on
May 11
Training in progress, step 500
ef8cfe5
verified
lole25
commited on
May 11
Training in progress, step 600
18e5fea
verified
lole25
commited on
May 11
Training in progress, step 200
2342b08
verified
lole25
commited on
May 11
Training in progress, step 100
09b24a5
verified
lole25
commited on
May 11
Training in progress, step 100
f4ded8b
verified
lole25
commited on
May 11