Cannot figure out prompt format

by LogicBombaklot - opened Oct 5

Oct 5

Thank you for ggufying it. I've downloaded it and loaded it up in LM Studio. I cannot figure out the prompt template, even after referring to the original model readme.

Any help would be appreciated.

ayymen

Oct 9

@LogicBombaklot Since this is not a chat model (not instruction-tuned), the presets in LM Studio are probably not appropriate.
I followed the prompt template for Machine Translation that the authors used (it's in the paper), but the model still outputs nonsense and in general, doesn't stop generating. This is the prompt I used:

Translate the following sentence from English to French
[English]: This is not working.
[French]:

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment