nm-testing
/

Meta-llama3-8b-Instruct-SmoothQuant-Fp8

Text Generation

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

Meta-llama3-8b-Instruct-SmoothQuant-Fp8 / config.json

Commit History

Updated compression_config to quantization_config

3c00b6e
verified

mgoin commited on 28 days ago

Upload folder using huggingface_hub

b60b65e
verified

RelaxingSnorlax commited on Jul 19