UnstableLlama
commited on
Commit
•
45ea009
1
Parent(s):
9fc1004
Update README.md
Browse files
README.md
CHANGED
@@ -121,7 +121,12 @@ code {
|
|
121 |
The model stock merging method attempts to make the model remain focused, tailored, and high-quality.
|
122 |
<h2>Quants:</h2>
|
123 |
<p>(Thanks to <a href="https://huggingface.co/mradermacher">@Mradermacher!</a>, please send them likes and follows!)</p>
|
124 |
-
<p><a href="https://huggingface.co/mradermacher/L3-MS-Astoria-70b-GGUF">L3-MS-Astoria-70b-GGUF (GGUFs)</a></p>
|
|
|
|
|
|
|
|
|
|
|
125 |
<p></p>
|
126 |
<h3>Config:</h3>
|
127 |
<pre><code>MODEL_NAME = "L3-MS-Astoria-70b"
|
|
|
121 |
The model stock merging method attempts to make the model remain focused, tailored, and high-quality.
|
122 |
<h2>Quants:</h2>
|
123 |
<p>(Thanks to <a href="https://huggingface.co/mradermacher">@Mradermacher!</a>, please send them likes and follows!)</p>
|
124 |
+
<p><a href="https://huggingface.co/mradermacher/L3-MS-Astoria-70b-GGUF">L3-MS-Astoria-70b-GGUF (GGUFs)</a></p>
|
125 |
+
<p><h2> ExLlamaV2 Quantization by UnstableLlama </h2></p>
|
126 |
+
|
127 |
+
[5.00 bits per weight in main](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/main)
|
128 |
+
|
129 |
+
[3.00 bits per weight branch](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/3bpw)
|
130 |
<p></p>
|
131 |
<h3>Config:</h3>
|
132 |
<pre><code>MODEL_NAME = "L3-MS-Astoria-70b"
|