Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
neuralmagic
/
Meta-Llama-3.1-8B-quantized.w8a8
like
1
Follow
Neural Magic
161
Text Generation
Transformers
Safetensors
8 languages
llama
int8
vllm
quantized
8-bit precision
text-generation-inference
Inference Endpoints
compressed-tensors
arxiv:
2210.17323
License:
llama3.1
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
f2a9838
Meta-Llama-3.1-8B-quantized.w8a8
Commit History
Update README.md
f2a9838
verified
alexmarques
commited on
Aug 21
Update README.md
043563b
verified
alexmarques
commited on
Aug 21
Update README.md
82e54a3
verified
alexmarques
commited on
Aug 21
Update README.md
be254c0
verified
alexmarques
commited on
Aug 13
Create README.md
1eed01c
verified
alexmarques
commited on
Jul 31
Upload folder using huggingface_hub
faa056e
verified
alexmarques
commited on
Jul 31
initial commit
8604987
verified
alexmarques
commited on
Jul 31