Hugging Face's logo

neuralmagic
/
Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
compressed-tensors
Model card Files Community
Meta-Llama-3-8B-Instruct-quantized.w8a8
  • 2 contributors
 History: 7 commits
mgoin's picture
mgoin
Updated compression_config to quantization_config
825bb7c verified