Commit
•
f08f8fa
1
Parent(s):
9903389
Update README.md
Browse files
README.md
CHANGED
|
@@ -2,4 +2,14 @@
|
|
| 2 |
license: mit
|
| 3 |
datasets:
|
| 4 |
- NobodyExistsOnTheInternet/GiftedConvoBeforeEcons
|
| 5 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: mit
|
| 3 |
datasets:
|
| 4 |
- NobodyExistsOnTheInternet/GiftedConvoBeforeEcons
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
+
Trained on over 20k instruct generated all by gpt-4 or humans
|
| 8 |
+
|
| 9 |
+
Dataset features:
|
| 10 |
+
1000 long evolved conversations based off LIMA
|
| 11 |
+
Subsection of correct PRM800k data
|
| 12 |
+
Subsection of CamelAI's Physics and Chemistry data
|
| 13 |
+
|
| 14 |
+
|
| 15 |
+
The model is trained with Qlora as well as Axolotl.
|