Update README.md
Browse files
README.md
CHANGED
|
@@ -71,8 +71,8 @@ def give_answer(instruction="Create a loop over [0, 6, 7 , 77] that prints its c
|
|
| 71 |
## Training
|
| 72 |
Finetuned for CSharp [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct). Max context length is restricted to 1024 tokens.
|
| 73 |
|
| 74 |
-
'Loss': 0.256045166015625 on 300k CSharp-related records
|
| 75 |
-
'Loss': 0.095714599609375 on 50k specific short prompts
|
| 76 |
|
| 77 |
## Sources
|
| 78 |
data contained (most data was around 500 tokens long < 1000, except large code files):
|
|
|
|
| 71 |
## Training
|
| 72 |
Finetuned for CSharp [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct). Max context length is restricted to 1024 tokens.
|
| 73 |
|
| 74 |
+
- 'Loss': 0.256045166015625 on 300k CSharp-related records
|
| 75 |
+
- 'Loss': 0.095714599609375 on 50k specific short prompts
|
| 76 |
|
| 77 |
## Sources
|
| 78 |
data contained (most data was around 500 tokens long < 1000, except large code files):
|