FluffyKaeloky
commited on
Commit
•
4ddc3bb
1
Parent(s):
0672eb6
Update README.md
Browse files
README.md
CHANGED
@@ -13,11 +13,11 @@ pipeline_tag: text-generation
|
|
13 |
(https://huggingface.co/smelborp/MixtralOrochi8x7B)
|
14 |
|
15 |
Quants:
|
16 |
-
- 6.0 bpw
|
17 |
-
- 5.5 bpw
|
18 |
-
- 3.5 bpw
|
19 |
-
- 3.0 bpw
|
20 |
-
- 2.5 bpw
|
21 |
|
22 |
Measurements file included if you want to do your own quants.
|
23 |
|
|
|
13 |
(https://huggingface.co/smelborp/MixtralOrochi8x7B)
|
14 |
|
15 |
Quants:
|
16 |
+
- [6.0 bpw](https://huggingface.co/FluffyKaeloky/MixtralOrochi8x7B-exl2-rpcal/tree/6.0bpw)
|
17 |
+
- [5.5 bpw](https://huggingface.co/FluffyKaeloky/MixtralOrochi8x7B-exl2-rpcal/tree/5.5bpw)
|
18 |
+
- [3.5 bpw](https://huggingface.co/FluffyKaeloky/MixtralOrochi8x7B-exl2-rpcal/tree/3.5bpw)
|
19 |
+
- [3.0 bpw](https://huggingface.co/FluffyKaeloky/MixtralOrochi8x7B-exl2-rpcal/tree/3.0bpw)
|
20 |
+
- [2.5 bpw](https://huggingface.co/FluffyKaeloky/MixtralOrochi8x7B-exl2-rpcal/tree/2.5bpw)
|
21 |
|
22 |
Measurements file included if you want to do your own quants.
|
23 |
|