neuralmagic
/

Phi-3-mini-128k-instruct-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Phi-3-mini-128k-instruct-quantized.w8a8

Commit History

Updated compression_config to quantization_config

0ab444b
verified

mgoin commited on 28 days ago

Update README.md

791a361
verified

alexmarques commited on Jul 18

Update README.md

4bafd06
verified

alexmarques commited on Jul 18

Create README.md

25992a4
verified

alexmarques commited on Jul 17

Upload folder using huggingface_hub

a35502e
verified

alexmarques commited on Jul 11

initial commit

4a30faf
verified

alexmarques commited on Jul 11