Maximofn
/

Llama-3-8B-Instruct-GPTQ-4bits

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3-8B-Instruct-GPTQ-4bits

Commit History

Tokenizers for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False

7560004
verified

Maximofn commited on Jul 26

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False

44cfdca
verified

Maximofn commited on Jul 25

AutoGPTQ model for meta-llama/Meta-Llama-3-8B-Instruct: 4bits, gr128, desc_act=False

7b038f8
verified

Maximofn commited on Jul 25

initial commit

6b26e40
verified

Maximofn commited on Jul 25