Error when trying to use this

#2
by DaveBurrows - opened

Hi,

I'm having problems using this model, the error is a missing file at https://huggingface.co/ucalyptus/prem-1B-chat-ONNX/resolve/main/onnx/decoder_model_merged.onnx

Tried both this and the q4 one and both quantised, but they all add the "_merged" to the file / url they're trying to load.

Also, any chance of a larger context window? I see you've done a 32k on another, but that's not in the ONNX format.

Any ideas?
Dave

Sign up or log in to comment