TheBloke

/

Redmond-Puffin-13B-GPTQ

like 27

I was getting short single sentences, until I changed to these settings and reloaded the model:
Model Loader: GPTQ-for-LLaMa
wbits 4
groupsize 128
model_type gptq