Update README.md
Browse files
README.md
CHANGED
|
@@ -46,7 +46,7 @@ https://huggingface.co/datasets/umarigan/falcon_feedback_instraction_Turkish
|
|
| 46 |
|
| 47 |
|
| 48 |
#### Training Hyperparameters
|
| 49 |
-
|
| 50 |
Some training arguments are as follow:
|
| 51 |
max_prompt_length=1024,
|
| 52 |
max_length=1536,
|
|
@@ -62,6 +62,7 @@ output_dir=new_model,
|
|
| 62 |
optim="paged_adamw_32bit",
|
| 63 |
warmup_steps=100,
|
| 64 |
fp16=True,
|
|
|
|
| 65 |
|
| 66 |
wandb results:
|
| 67 |
https://api.wandb.ai/links/umar-i-gan/0hnrvrdq
|
|
|
|
| 46 |
|
| 47 |
|
| 48 |
#### Training Hyperparameters
|
| 49 |
+
```
|
| 50 |
Some training arguments are as follow:
|
| 51 |
max_prompt_length=1024,
|
| 52 |
max_length=1536,
|
|
|
|
| 62 |
optim="paged_adamw_32bit",
|
| 63 |
warmup_steps=100,
|
| 64 |
fp16=True,
|
| 65 |
+
```
|
| 66 |
|
| 67 |
wandb results:
|
| 68 |
https://api.wandb.ai/links/umar-i-gan/0hnrvrdq
|