Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,10 @@ model-index:
|
|
| 6 |
results: []
|
| 7 |
---
|
| 8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
## This repo contains EXL2 quants of the model. If you need the original weights, please find them [here](https://huggingface.co/anthracite-org/magnum-v3-9b-chatml).
|
| 10 |
## Base repo only contains the measurement file, see revisions for your quant of choice.
|
| 11 |
|
|
|
|
| 6 |
results: []
|
| 7 |
---
|
| 8 |
|
| 9 |
+
## remember to downgrade to exllama 0.1.8 or update to 0.2.0 to receive upstream fixes
|
| 10 |
+
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
## This repo contains EXL2 quants of the model. If you need the original weights, please find them [here](https://huggingface.co/anthracite-org/magnum-v3-9b-chatml).
|
| 14 |
## Base repo only contains the measurement file, see revisions for your quant of choice.
|
| 15 |
|