BlueNipples's picture
Update README.md
e003e5b verified
|
raw
history blame
No virus
1.31 kB
metadata
license: apache-2.0
tags:
  - Solar
  - Mistral
  - Roleplay

SnowLotus Logo

3x GGUFs for https://huggingface.co/BlueNipples/SnowLotus-v2-10.7B when I can squeeze them down my slow internet + 2 for https://huggingface.co/BlueNipples/DaringLotus-v2-10.7b.

I'm super happy with these merges, they turned out great. Basically Daring is the slightly more creative/prose oriented one, but also slightly less coherent. They both have excellent prose for their size that is largely not very gpt-ish and are able to often take story context, lore entries and character card info into account. You can probably use these as your mainstay - which especially helpful if you GPU struggles with 13b, and honestly I think these models are probably equal to or better than any 13b anyway. I might be wrong, but I do think they are very good compared to anything I've personally run. See the individual model cards for merge recipe details.

Note: I'm running an importance matrix on these two models, so will be uploading possibly slightly improved quants when that process is done. I just found out calibration for IM works better on near random data, so will be redoing the iq quants I have already uploaded.