Hugging Face's logo

softmax
/
Llama-2-70b-chat-hf-marlin

Text Generation
Transformers
Safetensors
llama
nm-vllm
marlin
int4
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Llama-2-70b-chat-hf-marlin / quantize_config.json

Commit History

Upload folder using huggingface_hub
42a4564
verified

softmax commited on