Hugging Face's logo

Maximofn
/
Llama-3-8B-Instruct-GPTQ-4bits

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Llama-3-8B-Instruct-GPTQ-4bits / README.md

Commit History

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False
7b038f8
verified

Maximofn commited on