GGUF small language models
Collection
LMs of 8B parameters or less. Quantized in 8bit and 4bit representations, and converted to GGUF.
•
34 items
•
Updated
This model was converted to GGUF format from NousResearch/Hermes-2-Pro-Mistral-7B
using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
Base model
mistralai/Mistral-7B-v0.1