Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
DUAL-GPO-2
/
phi-2-irepo-chatml-v5-i2
like
0
Follow
DUAL-GPO-2
2
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
phi
alignment-handbook
Generated from Trainer
trl
dpo
custom_code
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Use this model
main
phi-2-irepo-chatml-v5-i2
/
adapter_model.safetensors
Commit History
Model save
c050790
verified
lole25
commited on
May 22
Training in progress, step 900
7211c1a
verified
lole25
commited on
May 22
Training in progress, step 800
689c3e3
verified
lole25
commited on
May 22
Training in progress, step 700
b661389
verified
lole25
commited on
May 22
Training in progress, step 600
f69b4c1
verified
lole25
commited on
May 22
Training in progress, step 500
d053f45
verified
lole25
commited on
May 22
Training in progress, step 400
c9a3d4d
verified
lole25
commited on
May 22
Training in progress, step 300
cd913ed
verified
lole25
commited on
May 22
Training in progress, step 100
3619ca6
verified
lole25
commited on
May 22