prompt format?
#1
by
pwroff
- opened
Any idea what are the settings for the prompt format or configuration.
I'm using LM Studio, I can load the model but get empty responses.
After fiddling a little bit, I found that it work well with ChatML. I was using the config for the smaller mixtral and it didn't work apparently.
Since this is a base model there isn't actually a prompt format, it may be able to figure out how to chat based on examples, but it has but been tuned for that and therefore would be to be multi shot promoted