what would be best sillytavern insturct&context template anyone willing to share?
The official template to use for this model should be the Mistral instruction template, the one that uses [INST] and [/INST]
I've found the Mistral context and instruct templates in SillyTavern to work the best. ChatML works too, but gives slightly worse responses.
The official template to use for this model should be the Mistral instruction template, the one that uses [INST] and [/INST]
I've found the Mistral context and instruct templates in SillyTavern to work the best. ChatML works too, but gives slightly worse responses.
Thanks, yeah, this is the one I'm using right now. This model really excels in terms of coherence. I've tried almost all L3 models, and this one surpasses them in my opinion. I'm using just 6.4bpw-exl2.
How did you avoid the short answers from the model? It's something I have been unable to fix and I don't know if it's my system prompt or template despite being the basic Mistral one.
How did you avoid the short answers from the model? It's something I have been unable to fix and I don't know if it's my system prompt or template despite being the basic Mistral one.
Use finetune like mini magnum 100000% better than this.