UnstableLlama commited on
Commit
45ea009
1 Parent(s): 9fc1004

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -121,7 +121,12 @@ code {
121
  The model stock merging method attempts to make the model remain focused, tailored, and high-quality.
122
  <h2>Quants:</h2>
123
  <p>(Thanks to <a href="https://huggingface.co/mradermacher">@Mradermacher!</a>, please send them likes and follows!)</p>
124
- <p><a href="https://huggingface.co/mradermacher/L3-MS-Astoria-70b-GGUF">L3-MS-Astoria-70b-GGUF (GGUFs)</a></p>
 
 
 
 
 
125
  <p></p>
126
  <h3>Config:</h3>
127
  <pre><code>MODEL_NAME = "L3-MS-Astoria-70b"
 
121
  The model stock merging method attempts to make the model remain focused, tailored, and high-quality.
122
  <h2>Quants:</h2>
123
  <p>(Thanks to <a href="https://huggingface.co/mradermacher">@Mradermacher!</a>, please send them likes and follows!)</p>
124
+ <p><a href="https://huggingface.co/mradermacher/L3-MS-Astoria-70b-GGUF">L3-MS-Astoria-70b-GGUF (GGUFs)</a></p>
125
+ <p><h2> ExLlamaV2 Quantization by UnstableLlama </h2></p>
126
+
127
+ [5.00 bits per weight in main](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/main)
128
+
129
+ [3.00 bits per weight branch](https://huggingface.co/UnstableLlama/Xwin-LM-13B-V0.2-exl2/tree/3bpw)
130
  <p></p>
131
  <h3>Config:</h3>
132
  <pre><code>MODEL_NAME = "L3-MS-Astoria-70b"