End of training

README.md

@@ -5,6 +5,8 @@ tags:
 - trl
 - sft
 - generated_from_trainer
+datasets:
+- mmlu_no_train
 model-index:
 - name: phi-1_5_fictional
   results: []
@@ -15,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # phi-1_5_fictional
 
-This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on an unknown dataset.
+This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on the mmlu_no_train dataset.
 
 ## Model description
 
@@ -34,13 +36,13 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 5e-10
-- train_batch_size: 8
-- eval_batch_size: 8
+- learning_rate: 5e-05
+- train_batch_size: 2
+- eval_batch_size: 2
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- training_steps: 10
+- num_epochs: 6
 
 ### Training results
 

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:71aef83b9ad28279840911a62fc5b0a3b5dd6cf9b6f677ac0540b99c1e1c8b40
+oid sha256:46add19fed50ef98fb38373c012b2852b27dc4c4907b41ec118e4a5c104b3a25
 size 4400216536