bluuwhale
/

Ashhwriter-Mistral-7B-GGUF

Not-For-All-Audiences

text-generation-inference

Model card Files Files and versions Community

Edit model card

This is a quantized model of Ashhwriter-Mistral-7B

Downloads last month: 18

GGUF

Model size

7.24B params

Architecture

llama

4-bit

5-bit

6-bit

8-bit

Inference API

Inference API (serverless) has been turned off for this model.

Model tree for bluuwhale/Ashhwriter-Mistral-7B-GGUF

Base model

lemonilia/Ashhwriter-Mistral-7B

Quantized

(1)

this model

Collection including bluuwhale/Ashhwriter-Mistral-7B-GGUF

GGUF Quantize Model 🖥️

GGUF Model Quantize Weight • 5 items • Updated Aug 5