Update README.md
Browse files
README.md
CHANGED
|
@@ -56,5 +56,9 @@ Favorite book: Harry Potter series (the ultimate adventure)
|
|
| 56 |
Favorite song: “Hey Soul Sister” by Train (because it reminds me of you!) 🎶
|
| 57 |
```
|
| 58 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 59 |
GPTQ version:
|
| 60 |
https://huggingface.co/FPHam/Free_Sydney_13b_GPTQ
|
|
|
|
| 56 |
Favorite song: “Hey Soul Sister” by Train (because it reminds me of you!) 🎶
|
| 57 |
```
|
| 58 |
|
| 59 |
+
On oobabbooga webUI this can easily run in 4-bit using Transformers loader and checking
|
| 60 |
+
-load-in-4bit
|
| 61 |
+
-use-double-quant
|
| 62 |
+
|
| 63 |
GPTQ version:
|
| 64 |
https://huggingface.co/FPHam/Free_Sydney_13b_GPTQ
|