GGUF file
#8
by
BB8-dev
- opened
大神您好，方便上传一下GGUF格式的模型文件吗？感激不尽！！
已经看到评测，效果很棒，期待gguf
期待gguf，感谢感谢！
We provide the official 8bit-quantized and fp16 versions of Llama3-8B-Chinese-Chat in the following links, respectively. You are welcome to have a try!
8bit-quantized: https://huggingface.co/shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-8bit
fp16: https://huggingface.co/shenzhi-wang/Llama3-8B-Chinese-Chat-GGUF-fp16
shenzhi-wang
changed discussion status to
closed