neuralmagic
/

Phi-3-medium-128k-instruct-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

Phi-3-medium-128k-instruct-quantized.w4a16 / config.json

Commit History

Updated compression_config to quantization_config

8670dfa
verified

mgoin commited on 28 days ago

Upload config.json with huggingface_hub

9b5ceb4
verified

abhinavnmagic commited on Jul 12