mradermacher
commited on
Commit
•
5de7c72
1
Parent(s):
c145ed3
auto-patch README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,328 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
<!-- ### quantize_version: 2 -->
|
2 |
<!-- ### output_tensor_quantised: 1 -->
|
3 |
<!-- ### convert_type: hf -->
|
4 |
<!-- ### vocab_type: -->
|
5 |
<!-- ### tags: -->
|
6 |
static quants of https://huggingface.co/CohereForAI/c4ai-command-r-plus
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model: CohereForAI/c4ai-command-r-plus
|
3 |
+
extra_gated_fields:
|
4 |
+
Affiliation: text
|
5 |
+
Country:
|
6 |
+
options:
|
7 |
+
- Aruba
|
8 |
+
- Afghanistan
|
9 |
+
- Angola
|
10 |
+
- Anguilla
|
11 |
+
- Åland Islands
|
12 |
+
- Albania
|
13 |
+
- Andorra
|
14 |
+
- United Arab Emirates
|
15 |
+
- Argentina
|
16 |
+
- Armenia
|
17 |
+
- American Samoa
|
18 |
+
- Antarctica
|
19 |
+
- French Southern Territories
|
20 |
+
- Antigua and Barbuda
|
21 |
+
- Australia
|
22 |
+
- Austria
|
23 |
+
- Azerbaijan
|
24 |
+
- Burundi
|
25 |
+
- Belgium
|
26 |
+
- Benin
|
27 |
+
- Bonaire Sint Eustatius and Saba
|
28 |
+
- Burkina Faso
|
29 |
+
- Bangladesh
|
30 |
+
- Bulgaria
|
31 |
+
- Bahrain
|
32 |
+
- Bahamas
|
33 |
+
- Bosnia and Herzegovina
|
34 |
+
- Saint Barthélemy
|
35 |
+
- Belarus
|
36 |
+
- Belize
|
37 |
+
- Bermuda
|
38 |
+
- Plurinational State of Bolivia
|
39 |
+
- Brazil
|
40 |
+
- Barbados
|
41 |
+
- Brunei-Darussalam
|
42 |
+
- Bhutan
|
43 |
+
- Bouvet-Island
|
44 |
+
- Botswana
|
45 |
+
- Central African Republic
|
46 |
+
- Canada
|
47 |
+
- Cocos (Keeling) Islands
|
48 |
+
- Switzerland
|
49 |
+
- Chile
|
50 |
+
- China
|
51 |
+
- Côte-dIvoire
|
52 |
+
- Cameroon
|
53 |
+
- Democratic Republic of the Congo
|
54 |
+
- Cook Islands
|
55 |
+
- Colombia
|
56 |
+
- Comoros
|
57 |
+
- Cabo Verde
|
58 |
+
- Costa Rica
|
59 |
+
- Cuba
|
60 |
+
- Curaçao
|
61 |
+
- Christmas Island
|
62 |
+
- Cayman Islands
|
63 |
+
- Cyprus
|
64 |
+
- Czechia
|
65 |
+
- Germany
|
66 |
+
- Djibouti
|
67 |
+
- Dominica
|
68 |
+
- Denmark
|
69 |
+
- Dominican Republic
|
70 |
+
- Algeria
|
71 |
+
- Ecuador
|
72 |
+
- Egypt
|
73 |
+
- Eritrea
|
74 |
+
- Western Sahara
|
75 |
+
- Spain
|
76 |
+
- Estonia
|
77 |
+
- Ethiopia
|
78 |
+
- Finland
|
79 |
+
- Fiji
|
80 |
+
- Falkland Islands (Malvinas)
|
81 |
+
- France
|
82 |
+
- Faroe Islands
|
83 |
+
- Federated States of Micronesia
|
84 |
+
- Gabon
|
85 |
+
- United Kingdom
|
86 |
+
- Georgia
|
87 |
+
- Guernsey
|
88 |
+
- Ghana
|
89 |
+
- Gibraltar
|
90 |
+
- Guinea
|
91 |
+
- Guadeloupe
|
92 |
+
- Gambia
|
93 |
+
- Guinea Bissau
|
94 |
+
- Equatorial Guinea
|
95 |
+
- Greece
|
96 |
+
- Grenada
|
97 |
+
- Greenland
|
98 |
+
- Guatemala
|
99 |
+
- French Guiana
|
100 |
+
- Guam
|
101 |
+
- Guyana
|
102 |
+
- Hong Kong
|
103 |
+
- Heard Island and McDonald Islands
|
104 |
+
- Honduras
|
105 |
+
- Croatia
|
106 |
+
- Haiti
|
107 |
+
- Hungary
|
108 |
+
- Indonesia
|
109 |
+
- Isle of Man
|
110 |
+
- India
|
111 |
+
- British Indian Ocean Territory
|
112 |
+
- Ireland
|
113 |
+
- Islamic Republic of Iran
|
114 |
+
- Iraq
|
115 |
+
- Iceland
|
116 |
+
- Israel
|
117 |
+
- Italy
|
118 |
+
- Jamaica
|
119 |
+
- Jersey
|
120 |
+
- Jordan
|
121 |
+
- Japan
|
122 |
+
- Kazakhstan
|
123 |
+
- Kenya
|
124 |
+
- Kyrgyzstan
|
125 |
+
- Cambodia
|
126 |
+
- Kiribati
|
127 |
+
- Saint-Kitts-and-Nevis
|
128 |
+
- South Korea
|
129 |
+
- Kuwait
|
130 |
+
- Lao-Peoples-Democratic-Republic
|
131 |
+
- Lebanon
|
132 |
+
- Liberia
|
133 |
+
- Libya
|
134 |
+
- Saint-Lucia
|
135 |
+
- Liechtenstein
|
136 |
+
- Sri Lanka
|
137 |
+
- Lesotho
|
138 |
+
- Lithuania
|
139 |
+
- Luxembourg
|
140 |
+
- Latvia
|
141 |
+
- Macao
|
142 |
+
- Saint Martin (French-part)
|
143 |
+
- Morocco
|
144 |
+
- Monaco
|
145 |
+
- Republic of Moldova
|
146 |
+
- Madagascar
|
147 |
+
- Maldives
|
148 |
+
- Mexico
|
149 |
+
- Marshall Islands
|
150 |
+
- North Macedonia
|
151 |
+
- Mali
|
152 |
+
- Malta
|
153 |
+
- Myanmar
|
154 |
+
- Montenegro
|
155 |
+
- Mongolia
|
156 |
+
- Northern Mariana Islands
|
157 |
+
- Mozambique
|
158 |
+
- Mauritania
|
159 |
+
- Montserrat
|
160 |
+
- Martinique
|
161 |
+
- Mauritius
|
162 |
+
- Malawi
|
163 |
+
- Malaysia
|
164 |
+
- Mayotte
|
165 |
+
- Namibia
|
166 |
+
- New Caledonia
|
167 |
+
- Niger
|
168 |
+
- Norfolk Island
|
169 |
+
- Nigeria
|
170 |
+
- Nicaragua
|
171 |
+
- Niue
|
172 |
+
- Netherlands
|
173 |
+
- Norway
|
174 |
+
- Nepal
|
175 |
+
- Nauru
|
176 |
+
- New Zealand
|
177 |
+
- Oman
|
178 |
+
- Pakistan
|
179 |
+
- Panama
|
180 |
+
- Pitcairn
|
181 |
+
- Peru
|
182 |
+
- Philippines
|
183 |
+
- Palau
|
184 |
+
- Papua New Guinea
|
185 |
+
- Poland
|
186 |
+
- Puerto Rico
|
187 |
+
- North Korea
|
188 |
+
- Portugal
|
189 |
+
- Paraguay
|
190 |
+
- State of Palestine
|
191 |
+
- French Polynesia
|
192 |
+
- Qatar
|
193 |
+
- Réunion
|
194 |
+
- Romania
|
195 |
+
- Russia
|
196 |
+
- Rwanda
|
197 |
+
- Saudi Arabia
|
198 |
+
- Sudan
|
199 |
+
- Senegal
|
200 |
+
- Singapore
|
201 |
+
- South Georgia and the South Sandwich Islands
|
202 |
+
- Saint Helena Ascension and Tristan da Cunha
|
203 |
+
- Svalbard and Jan Mayen
|
204 |
+
- Solomon Islands
|
205 |
+
- Sierra Leone
|
206 |
+
- El Salvador
|
207 |
+
- San Marino
|
208 |
+
- Somalia
|
209 |
+
- Saint Pierre and Miquelon
|
210 |
+
- Serbia
|
211 |
+
- South Sudan
|
212 |
+
- Sao Tome and Principe
|
213 |
+
- Suriname
|
214 |
+
- Slovakia
|
215 |
+
- Slovenia
|
216 |
+
- Sweden
|
217 |
+
- Eswatini
|
218 |
+
- Sint Maarten (Dutch-part)
|
219 |
+
- Seychelles
|
220 |
+
- Syrian Arab Republic
|
221 |
+
- Turks and Caicos Islands
|
222 |
+
- Chad
|
223 |
+
- Togo
|
224 |
+
- Thailand
|
225 |
+
- Tajikistan
|
226 |
+
- Tokelau
|
227 |
+
- Turkmenistan
|
228 |
+
- Timor Leste
|
229 |
+
- Tonga
|
230 |
+
- Trinidad and Tobago
|
231 |
+
- Tunisia
|
232 |
+
- Turkey
|
233 |
+
- Tuvalu
|
234 |
+
- Taiwan
|
235 |
+
- United Republic of Tanzania
|
236 |
+
- Uganda
|
237 |
+
- Ukraine
|
238 |
+
- United States Minor Outlying Islands
|
239 |
+
- Uruguay
|
240 |
+
- United-States
|
241 |
+
- Uzbekistan
|
242 |
+
- Holy See (Vatican City State)
|
243 |
+
- Saint Vincent and the Grenadines
|
244 |
+
- Bolivarian Republic of Venezuela
|
245 |
+
- Virgin Islands British
|
246 |
+
- Virgin Islands U.S.
|
247 |
+
- VietNam
|
248 |
+
- Vanuatu
|
249 |
+
- Wallis and Futuna
|
250 |
+
- Samoa
|
251 |
+
- Yemen
|
252 |
+
- South Africa
|
253 |
+
- Zambia
|
254 |
+
- Zimbabwe
|
255 |
+
type: select
|
256 |
+
I agree to use this model for non-commercial use ONLY: checkbox
|
257 |
+
Name: text
|
258 |
+
Receive email updates on C4AI and Cohere research, events, products and services?:
|
259 |
+
options:
|
260 |
+
- Yes
|
261 |
+
- No
|
262 |
+
type: select
|
263 |
+
extra_gated_prompt: By submitting this form, you agree to the [License Agreement](https://cohere.com/c4ai-cc-by-nc-license) and
|
264 |
+
acknowledge that the information you provide will be collected, used, and shared
|
265 |
+
in accordance with Cohere’s [Privacy Policy]( https://cohere.com/privacy).
|
266 |
+
language:
|
267 |
+
- en
|
268 |
+
- fr
|
269 |
+
- de
|
270 |
+
- es
|
271 |
+
- it
|
272 |
+
- pt
|
273 |
+
- ja
|
274 |
+
- ko
|
275 |
+
- zh
|
276 |
+
- ar
|
277 |
+
library_name: transformers
|
278 |
+
license: cc-by-nc-4.0
|
279 |
+
quantized_by: mradermacher
|
280 |
+
---
|
281 |
+
## About
|
282 |
+
|
283 |
<!-- ### quantize_version: 2 -->
|
284 |
<!-- ### output_tensor_quantised: 1 -->
|
285 |
<!-- ### convert_type: hf -->
|
286 |
<!-- ### vocab_type: -->
|
287 |
<!-- ### tags: -->
|
288 |
static quants of https://huggingface.co/CohereForAI/c4ai-command-r-plus
|
289 |
+
|
290 |
+
<!-- provided-files -->
|
291 |
+
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
|
292 |
+
## Usage
|
293 |
+
|
294 |
+
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
295 |
+
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
296 |
+
more details, including on how to concatenate multi-part files.
|
297 |
+
|
298 |
+
## Provided Quants
|
299 |
+
|
300 |
+
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
301 |
+
|
302 |
+
| Link | Type | Size/GB | Notes |
|
303 |
+
|:-----|:-----|--------:|:------|
|
304 |
+
| [GGUF](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q2_K.gguf) | Q2_K | 39.6 | |
|
305 |
+
| [GGUF](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.IQ3_S.gguf) | IQ3_S | 46.1 | beats Q3_K* |
|
306 |
+
| [PART 1](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q4_K_S.gguf.part1of2) [PART 2](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q4_K_S.gguf.part2of2) | Q4_K_S | 59.7 | fast, recommended |
|
307 |
+
| [PART 1](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q8_0.gguf.part1of3) [PART 2](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q8_0.gguf.part2of3) [PART 3](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q8_0.gguf.part3of3) | Q8_0 | 110.4 | fast, best quality |
|
308 |
+
|
309 |
+
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
310 |
+
types (lower is better):
|
311 |
+
|
312 |
+
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
|
313 |
+
|
314 |
+
And here are Artefact2's thoughts on the matter:
|
315 |
+
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
316 |
+
|
317 |
+
## FAQ / Model Request
|
318 |
+
|
319 |
+
See https://huggingface.co/mradermacher/model_requests for some answers to
|
320 |
+
questions you might have and/or if you want some other model quantized.
|
321 |
+
|
322 |
+
## Thanks
|
323 |
+
|
324 |
+
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
325 |
+
me use its servers and providing upgrades to my workstation to enable
|
326 |
+
this work in my free time.
|
327 |
+
|
328 |
+
<!-- end -->
|