neuralmagic
/

Phi-3-medium-128k-instruct-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

Phi-3-medium-128k-instruct-quantized.w4a16

3 contributors

History: 6 commits

abhinavnmagic's picture

Upload model-00002-of-00002.safetensors with huggingface_hub

34131fd verified 4 months ago

.gitattributes

1.52 kB

initial commit 4 months ago
config.json

4.24 kB

Upload config.json with huggingface_hub 4 months ago
configuration_phi3.py

10.4 kB

Upload configuration_phi3.py with huggingface_hub 4 months ago
generation_config.json

172 Bytes

Upload generation_config.json with huggingface_hub 4 months ago
model-00001-of-00002.safetensors

4.93 GB
LFS

Upload model-00001-of-00002.safetensors with huggingface_hub 4 months ago
model-00002-of-00002.safetensors

2.75 GB
LFS

Upload model-00002-of-00002.safetensors with huggingface_hub 4 months ago