Maximofn
/

Llama-3-8B-Instruct-GPTQ-3bits

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-3-8B-Instruct-GPTQ-3bits / generation_config.json

Commit History

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 3bits, gr128, desc_act=False

422fd94
verified

Maximofn commited on Jul 25