README.md

---

library_name: transformers
inference:
  parameters:
    temperature: 1
    top_p: 0.95
    top_k: 40
    repetition_penalty: 1.2
license: apache-2.0
language:
- en
pipeline_tag: text-generation

---

[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)


# QuantFactory/Ministral-4b-instruct-GGUF
This is quantized version of [ministral/Ministral-4b-instruct](https://huggingface.co/ministral/Ministral-4b-instruct) created using llama.cpp

# Original Model Card



![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642b04e4ecec03b44649e318/AeJJFLB8s_wIaCKpNfac1.jpeg)



### Model Description

<!-- Provide a longer summary of what this model is. -->

Ministral is a series of language model, build with same architecture as the famous Mistral model, but with less size.

- **Model type:** A 4B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
- **Language(s) (NLP):** Primarily English
- **License:** Apache 2.0
- **Finetuned from model:** [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)