File size: 506 Bytes
a5aafa3
1a2ffb2
be7dc8b
1a2ffb2
 
 
 
 
424e189
1a2ffb2
 
a5aafa3
1091e55
424e189
7282a3e
 
be7dc8b
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
---
inference: false
license: mit
license_name: microsoft-research-license
license_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE
language:
- en
pipeline_tag: text-generation
tags:
- nlp
- code
---
This is a quantized GGUF version of Microsoft Phi-2 to 4_0, 8_0 bits and the converted 16 FP model.

(link to the original model : https://huggingface.co/microsoft/phi-2)

*Disclamer* : make sure to have the latest version of llama.cpp after commit b9e74f9bca5fdf7d0a22ed25e7a9626335fdfa48