justinthelaw
/

Phi-3-mini-128k-instruct-4bit-128g-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

justinthelaw commited on Jul 30

Commit

fc7d4b2

•

1 Parent(s): 74b5937

README GPTQ dataset

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -27,9 +27,9 @@ This repo contains GPTQ 4-bit, 128g Group Size, quantized model files for the re
 Models are released as sharded safetensors files.
-| Bits | GS | AWQ Dataset | Seq Len | Size |
 | ---- | -- | ----------- | ------- | ---- |
-| 4 | 128 | [pile-val-backup](mit-han-lab/pile-val-backup) | 128000  | 2.28 GB
 <!-- README_AWQ.md-provided-files end -->

 Models are released as sharded safetensors files.
+| Bits | GS | GPTQ Dataset | Seq Len | Size |
 | ---- | -- | ----------- | ------- | ---- |
+| 4 | 128 | [wikitext2](https://huggingface.co/datasets/mindchain/wikitext2) | 128,000  | 2.28 GB
 <!-- README_AWQ.md-provided-files end -->