Where can we find the GGUF version of this model?
#14
by
AayushShah
- opened
If there are any resources if we can find this Llama based model in the GGUF format, please share.
Thanks.
You can use convert tool from llama.cpp to build the GGUF format model.
Yeah, of course.
Keeping this discussion open as in future if I find (or create) a GGUF version, I can share a link.
Did you find it? If not there is https://huggingface.co/TheBloke/nsql-llama-2-7B-GGUF