v000000
/

L3.1-Niitorm-8B-DPO-t0.0001

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

v000000 commited on Sep 19

Commit

23620ba

•

1 Parent(s): 0bb2561

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -63,7 +63,9 @@ parameters:
   t:
     - value: 0.0001
 dtype: bfloat16
-out_type: float16 #oops
 ```
 *Resultant merge finetuned* on [jondurbin/gutenberg-dpo-v0.1](https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1) for 1 epoch, 1.5e-5 learning rate, on Nvidia A100.

   t:
     - value: 0.0001
 dtype: bfloat16
+# Then, DPO Finetune
 ```
 *Resultant merge finetuned* on [jondurbin/gutenberg-dpo-v0.1](https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1) for 1 epoch, 1.5e-5 learning rate, on Nvidia A100.