GGML f16, q4_0, q4_1, q4_2, q4_3
#4
by
oeathus
- opened
I converted and quantized these with https://github.com/ggerganov/ggml/ on a MacBook pro M1 w/ 16GB RAM.
https://huggingface.co/oeathus/stablelm-7b-sft-v7-epoch-3-ggml-q4