GGUF possible ?
#5
by
gopi87
- opened
cool model !! looks like now days were trying to optimize the model size rather then creating large model and i really welcome that this came from nvivdia!!
gguf possible @MaziyarPanahi ?
Unfortunately it seems the model is not supported yes in Llama.cpp
https://huggingface.co/Deci/DeciLM-7B-instruct-GGUF
How did they make the GGUF?