Broken model?

#1
by americancookie - opened

@mradermacher

Hi Michael, this model seems to be a quant from the broken version. The correct model is at:
https://huggingface.co/failspy/Llama-3-70B-Instruct-abliterated-GGUF-fixed

Could you please do a requant :)? Thanks!

That seems to link to a repo with a gguf quant, not the original model? I quantized the original model, which is still up. If my quants are broken, then requating the model will not change anything.

Oops, my bad, you're right! :) thanks!

americancookie changed discussion status to closed

Sign up or log in to comment