Commit
•
afd1bb4
1
Parent(s):
cb575e0
Update README.md
Browse files
README.md
CHANGED
|
@@ -15,6 +15,8 @@ After testing the new important matrix quants for 11b and 8x7b models and being
|
|
| 15 |
|
| 16 |
<b>❗❗Need a different quantization/model? Please open a community post and I'll get back to you - thanks ❗❗ </b>
|
| 17 |
|
|
|
|
|
|
|
| 18 |
(Credits to [TeeZee](https://huggingface.co/TeeZee/) for the original model and [ikawrakow](https://github.com/ikawrakow) for the stellar work on IQ quants)
|
| 19 |
|
| 20 |
---
|
|
|
|
| 15 |
|
| 16 |
<b>❗❗Need a different quantization/model? Please open a community post and I'll get back to you - thanks ❗❗ </b>
|
| 17 |
|
| 18 |
+
Newer quants (IQ3_S, IQ4_NL, etc) are confirmed working in Koboldcpp as of 1.59.1 - if you run into any issues kindly let me know.
|
| 19 |
+
|
| 20 |
(Credits to [TeeZee](https://huggingface.co/TeeZee/) for the original model and [ikawrakow](https://github.com/ikawrakow) for the stellar work on IQ quants)
|
| 21 |
|
| 22 |
---
|