nm-testing
/

Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test

Commit History

Updated compression_config to quantization_config

0f9b380
verified

mgoin commited on 28 days ago

Upload folder using huggingface_hub

d3a4303
verified

robertgshaw2 commited on Jun 25

initial commit

36ee492
verified

robertgshaw2 commited on Jun 25