Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
LaoRay
/
zephyr-7b-dpo-lora-r16-20k
like
0
PEFT
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
trl
dpo
Generated from Trainer
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Use this model
32da1fc
zephyr-7b-dpo-lora-r16-20k
Commit History
Model save
32da1fc
verified
LaoRay
commited on
Aug 16
Training in progress, step 1250
669612e
verified
LaoRay
commited on
Aug 16
Training in progress, step 1200
10160e7
verified
LaoRay
commited on
Aug 16
Training in progress, step 1100
61b0687
verified
LaoRay
commited on
Aug 16
Training in progress, step 1000
be7538f
verified
LaoRay
commited on
Aug 16
Training in progress, step 900
a7da6a5
verified
LaoRay
commited on
Aug 16
Training in progress, step 800
5156e2b
verified
LaoRay
commited on
Aug 16
Training in progress, step 700
670f41c
verified
LaoRay
commited on
Aug 16
Training in progress, step 600
9ce53e8
verified
LaoRay
commited on
Aug 16
Training in progress, step 500
3a53c10
verified
LaoRay
commited on
Aug 16
Training in progress, step 400
df05c33
verified
LaoRay
commited on
Aug 16
Training in progress, step 300
4c4fc0d
verified
LaoRay
commited on
Aug 16
Training in progress, step 200
80dfa7f
verified
LaoRay
commited on
Aug 16
Training in progress, step 100
a9cc3a3
verified
LaoRay
commited on
Aug 16
initial commit
21f21fb
verified
LaoRay
commited on
Aug 16