this repo is very use ful to me!
#1
by
Rsnarsna
- opened
and share phi3-mini quantization process python logic!
because, i try to quentize the phi3 model via tranformers ,it run perfectly.
the problem i facing to convert huggingface model to gguf format!
so, share your uantivation config python its very helpfuf for me and possible to learn begginers esaily to this process flow!