Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
jikaixuan
/
zephyr-7b-dpo-qlora
like
0
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
4-bit precision
bitsandbytes
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
9210b4f
zephyr-7b-dpo-qlora
/
training_args.bin
Commit History
Model save
4790ddb
verified
jikaixuan
commited on
Feb 20
Model save
44e3e84
verified
jikaixuan
commited on
Feb 19
Model save
49b9b9f
verified
jikaixuan
commited on
Feb 19
Training in progress, step 400
f7c95fc
verified
jikaixuan
commited on
Feb 19
Training in progress, step 400
3bfa5b1
verified
jikaixuan
commited on
Feb 19
Training in progress, step 300
937bdfb
verified
jikaixuan
commited on
Feb 19
Training in progress, step 200
90d7786
verified
jikaixuan
commited on
Feb 19
Training in progress, step 100
834ad57
verified
jikaixuan
commited on
Jan 15
Training in progress, step 100
04ab470
verified
jikaixuan
commited on
Jan 14