GGUF quants

#1
by dranger003 - opened

Thanks for this great model! I converted to GGUF and created a few quantized versions here:
https://huggingface.co/dranger003/bagel-dpo-20b-v04-llama-iMat.GGUF

Sign up or log in to comment