TheBloke
/

stable-vicuna-13B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Apr 28, 2023

Commit

56b2ff7

•

1 Parent(s): 2ec34de

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -53,7 +53,6 @@ It was created without the `--act-order` parameter. It may have slightly lower i
 * `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`
   * Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
   * Works with text-generation-webui one-click-installers
-  * Works on Windows
   * Parameters: Groupsize = 128g. No act-order.
   * Command used to create the GPTQ:
     ```
@@ -69,7 +68,7 @@ To access this file, please switch to the `latest` branch fo this repo and downl
 * `stable-vicuna-13B-GPTQ-4bit.latest.act-order.safetensors`
   * Only works with recent GPTQ-for-LLaMa code
   * **Does not** work with text-generation-webui one-click-installers
-  * Parameters: Groupsize = 128g. act-order.
   * Offers highest quality quantisation, but requires recent GPTQ-for-LLaMa code
   * Command used to create the GPTQ:
     ```

 * `stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`
   * Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
   * Works with text-generation-webui one-click-installers
   * Parameters: Groupsize = 128g. No act-order.
   * Command used to create the GPTQ:
     ```
 * `stable-vicuna-13B-GPTQ-4bit.latest.act-order.safetensors`
   * Only works with recent GPTQ-for-LLaMa code
   * **Does not** work with text-generation-webui one-click-installers
+  * Parameters: Groupsize = 128g. **act-order**.
   * Offers highest quality quantisation, but requires recent GPTQ-for-LLaMa code
   * Command used to create the GPTQ:
     ```