File size: 556 Bytes
7a87175 ada667b ff0925e 7a87175 ff0925e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
license: other
license_name: yi-license
license_link: https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE
language:
- en
library_name: transformers
base_model: []
tags:
- mergekit
- merge
- Yi
- gguf
---
See the main model card: https://huggingface.co/brucethemoose/Yi-34B-200K-RPMerge
Experimental imatrix quantizations, at 16K context, using a cocktail of data taken from the exllamav2 repo, kalomaze's random token tests and some stories.
Consider them experimental! But they may be better than the equivalent non-matrix GGUFs. Or they may not! |