Update README.md
Browse files
README.md
CHANGED
|
@@ -11,4 +11,7 @@ tags:
|
|
| 11 |
---
|
| 12 |
This is a quantized GGUF version of Microsoft Phi-2 to 4_0, 8_0 bits and the converted to GGUF 16FP model.
|
| 13 |
|
| 14 |
-
(link to the original model : https://huggingface.co/microsoft/phi-2)
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
---
|
| 12 |
This is a quantized GGUF version of Microsoft Phi-2 to 4_0, 8_0 bits and the converted to GGUF 16FP model.
|
| 13 |
|
| 14 |
+
(link to the original model : https://huggingface.co/microsoft/phi-2)
|
| 15 |
+
|
| 16 |
+
It won't work unless you use this fork with those modofication (https://github.com/mrgraycode/llama.cpp/commit/12cc80cb8975aea3bc9f39d3c9b84f7001ab94c5#diff-150dc86746a90bad4fc2c3334aeb9b5887b3adad3cc1459446717638605348efR6239) of llamacpp : https://github.com/mrgraycode/llama.cpp
|
| 17 |
+
|