license: apache-2.0 | |
tags: | |
- Solar | |
- Mistral | |
- Roleplay | |
![SnowLotus Logo](https://cdn-uploads.huggingface.co/production/uploads/64bb1109aaccfd28b023bcec/gTQtPK46laLIFg0RTAv73.png) | |
3x GGUFs for https://huggingface.co/BlueNipples/SnowLotus-v2-10.7B when I can squeeze them down my slow internet + 2 for https://huggingface.co/BlueNipples/DaringLotus-v2-10.7b. | |
I'm super happy with these merges, they turned out great. Basically Daring is the slightly more creative/prose oriented one, but also slightly less coherent. They both have excellent prose for their size that is largely not very gpt-ish and are able to often take story context, lore entries and character card info into account. You can probably use these as your mainstay - which especially helpful if you GPU struggles with 13b, and honestly I think these models are _probably_ equal to or better than any 13b anyway. I might be wrong, but I do think they are very good compared to anything I've personally run. See the individual model cards for merge recipe details. | |
Note: I'm running an importance matrix on these two models, so will be uploading possibly slightly improved quants when that process is done. I just found out calibration for IM works better on near random data, so will be redoing the iq quants I have already uploaded. |