brucethemoose
commited on
Commit
•
ff0925e
1
Parent(s):
ada667b
Update README.md
Browse files
README.md
CHANGED
@@ -15,6 +15,6 @@ tags:
|
|
15 |
|
16 |
See the main model card: https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge
|
17 |
|
18 |
-
Experimental imatrix quantizations using a cocktail of data
|
19 |
|
20 |
-
Consider them experimental! But they may be better than the equivalent non-matrix GGUFs.
|
|
|
15 |
|
16 |
See the main model card: https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge
|
17 |
|
18 |
+
Experimental imatrix quantizations, at 16K context, using a cocktail of data taken from the exllamav2 repo, kalomaze's random token tests and some stories.
|
19 |
|
20 |
+
Consider them experimental! But they may be better than the equivalent non-matrix GGUFs. Or they may not!
|