Update README.md
Browse files
README.md
CHANGED
@@ -37,19 +37,18 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
|
|
37 |
|
38 |
## How to easily download and use this model in text-generation-webui
|
39 |
|
40 |
-
|
41 |
|
42 |
1. Click the **Model tab**.
|
43 |
2. Under **Download custom model or LoRA**, enter `TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ`.
|
44 |
3. Click **Download**.
|
45 |
-
4.
|
46 |
-
5.
|
47 |
-
6. In the **Model
|
48 |
-
7.
|
49 |
-
8.
|
50 |
-
|
51 |
-
|
52 |
-
11. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
|
53 |
|
54 |
## Provided files
|
55 |
|
|
|
37 |
|
38 |
## How to easily download and use this model in text-generation-webui
|
39 |
|
40 |
+
Please make sure you're using the latest version of text-generation-webui
|
41 |
|
42 |
1. Click the **Model tab**.
|
43 |
2. Under **Download custom model or LoRA**, enter `TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ`.
|
44 |
3. Click **Download**.
|
45 |
+
4. The model will start downloading. Once it's finished it will say "Done"
|
46 |
+
5. In the top left, click the refresh icon next to **Model**.
|
47 |
+
6. In the **Model** dropdown, choose the model you just downloaded: `Wizard-Vicuna-30B-Uncensored-GPTQ`
|
48 |
+
7. The model will automatically load, and is now ready for use!
|
49 |
+
8. If you want any custom settings, set them and then click **Save settings for this model** followed by **Reload the Model** in the top right.
|
50 |
+
* Note that you do not need to set GPTQ parameters any more. These should all be set to default values, as they are now set automatically from the file `quantize_config.json`.
|
51 |
+
9. Once you're ready, click the **Text Generation tab** and enter a prompt to get started!
|
|
|
52 |
|
53 |
## Provided files
|
54 |
|