| license: other | |
| license_name: yi-license | |
| license_link: https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE | |
| language: | |
| - en | |
| library_name: transformers | |
| base_model: [] | |
| tags: | |
| - mergekit | |
| - merge | |
| - Yi | |
| - gguf | |
| Experimental imatrix quantizations using a cocktail of data, taken from the exllamav2 repo, kalomaze's random token tests and some stories. | |
| Consider them experimental! But they may be better than the equivalent non-matrix GGUFs. |