UnstableLlama
commited on
Commit
•
d42e24f
1
Parent(s):
0571b6e
Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,22 @@ Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment
|
|
10 |
<a href="https://github.com/Xwin-LM/Xwin-LM"><img src="https://img.shields.io/badge/GitHub-yellow.svg?style=social&logo=github"></a><a href="https://huggingface.co/Xwin-LM"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Models-blue"></a>
|
11 |
</p>
|
12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
14 |
|
15 |
|
16 |
**Step up your LLM alignment with Xwin-LM!**
|
|
|
10 |
<a href="https://github.com/Xwin-LM/Xwin-LM"><img src="https://img.shields.io/badge/GitHub-yellow.svg?style=social&logo=github"></a><a href="https://huggingface.co/Xwin-LM"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Models-blue"></a>
|
11 |
</p>
|
12 |
|
13 |
+
---
|
14 |
+
<p><h2> ExLlamaV2 Quantization by UnstableLlama </h2></p>
|
15 |
+
|
16 |
+
[5.00 bits per weight in main](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/main)
|
17 |
+
|
18 |
+
[3.00 bits per weight branch](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/3bpw)
|
19 |
+
|
20 |
+
[3.50 bits per weight branch](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/3.5bpw)
|
21 |
|
22 |
+
[4.00 bits per weight branch](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/4bpw)
|
23 |
+
|
24 |
+
[4.65 bits per weight branch](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/4.65bpw)
|
25 |
+
|
26 |
+
[6.00 bits per weight branch](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/6bpw)
|
27 |
+
|
28 |
+
---
|
29 |
|
30 |
|
31 |
**Step up your LLM alignment with Xwin-LM!**
|