Qwen
/

Qwen1.5-72B-Chat

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JustinLin610 commited on Feb 5

Commit

3ade55f

•

1 Parent(s): ef28d43

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -75,7 +75,7 @@ generated_ids = [
 response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
 ```
-For quantized models, we advise you to use the GPTQ, AWQ, and GGUF correspondents, namely `Qwen1.5-72B-Chat-GPTQ`, `Qwen1.5-72B-Chat-AWQ`, and `Qwen1.5-72B-Chat-GGUF`.
 ## Tips

 response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
 ```
+For quantized models, we advise you to use the GPTQ, AWQ, and GGUF correspondents, namely `Qwen1.5-72B-Chat-GPTQ-Int8`, `Qwen1.5-72B-Chat-AWQ`, and `Qwen1.5-72B-Chat-GGUF`.
 ## Tips