Hugging Face's logo

Lewdiculous
/
Kunocchini-7b-128k-test-GGUF-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
Merge
mergekit
Model card Files Community
1
Kunocchini-7b-128k-test-GGUF-Imatrix / v2_Kunocchini-7b-128k-test-IQ4_NL-imatrix.gguf

Commit History

Add: New Q4 quant-types, great results and much smaller sizes! IQ4_NL and IQ4_XS
0870fbe
verified

Lewdiculous commited on