s3nh

/

Mistral_Sonyichi-7B-slerp

like 1

I like it a lot, really good output. Ill make the quants in a few day max.

Ok I decided to speed up, heres the quants. If you need higher than q5 just let me know pls :)

https://huggingface.co/s3nh/Mistral_Sonyichi-7B-slerp-GGUF

I usually go for Q6 or Q8 for 7B LLM's. But Q5K_M is good enough to test and will benefit more users probably.

Thank you!!

i can go for higher one if you want, no problem. If you have any requests, write me here or on x.com/s3nhs3nh, Ill be glad to help ^^