Update README.md

README.md

@@ -1,3 +1,45 @@
----
-license: apache-2.0
----
+---
+base_model: mistralai/mathstral-7B-v0.1
+library_name: transformers
+quantized_by: InferenceIllusionist
+language:
+  - en
+  - fr
+  - de
+  - es
+  - it
+  - pt
+  - ru
+  - zh
+  - ja
+tags:
+- iMat
+- gguf
+- Mistral
+- Math
+license: apache-2.0
+---
+<img src="https://i.imgur.com/P68dXux.png" width="400"/>
+
+# Mistral-Nemo-Instruct-12B-iMat-GGUF
+
+<b>Important Note: Inferencing is *only* available on this fork of llama.cpp at the moment: https://github.com/ggerganov/llama.cpp/pull/8604 
+
+Other front-ends like the main branch of llama.cpp, kobold.cpp, and text-generation-web-ui may not work as intended.</b>
+
+Quantized from fp16.
+* Weighted quantizations were creating using fp16 GGUF and groups_merged.txt in 92 chunks and n_ctx=512
+* Static fp16 also included in repo
+
+For a brief rundown of iMatrix quant performance please see this [PR](https://github.com/ggerganov/llama.cpp/pull/5747)
+
+<i>All quants are verified working prior to uploading to repo for your safety and convenience</i>
+
+<b>KL-Divergence Reference Chart</b>
+ (Click on image to view in full size)
+[<img src="https://i.imgur.com/mV0nYdA.png" width="920"/>](https://i.imgur.com/mV0nYdA.png)
+
+
+<b>Tips:</b> There's no need to download the entire repo, just pick one of the GGUF files. 
+
+Original model card can be found [here](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407)