mradermacher commited on
Commit
5de7c72
1 Parent(s): c145ed3

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +322 -0
README.md CHANGED
@@ -1,6 +1,328 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  <!-- ### quantize_version: 2 -->
2
  <!-- ### output_tensor_quantised: 1 -->
3
  <!-- ### convert_type: hf -->
4
  <!-- ### vocab_type: -->
5
  <!-- ### tags: -->
6
  static quants of https://huggingface.co/CohereForAI/c4ai-command-r-plus
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: CohereForAI/c4ai-command-r-plus
3
+ extra_gated_fields:
4
+ Affiliation: text
5
+ Country:
6
+ options:
7
+ - Aruba
8
+ - Afghanistan
9
+ - Angola
10
+ - Anguilla
11
+ - Åland Islands
12
+ - Albania
13
+ - Andorra
14
+ - United Arab Emirates
15
+ - Argentina
16
+ - Armenia
17
+ - American Samoa
18
+ - Antarctica
19
+ - French Southern Territories
20
+ - Antigua and Barbuda
21
+ - Australia
22
+ - Austria
23
+ - Azerbaijan
24
+ - Burundi
25
+ - Belgium
26
+ - Benin
27
+ - Bonaire Sint Eustatius and Saba
28
+ - Burkina Faso
29
+ - Bangladesh
30
+ - Bulgaria
31
+ - Bahrain
32
+ - Bahamas
33
+ - Bosnia and Herzegovina
34
+ - Saint Barthélemy
35
+ - Belarus
36
+ - Belize
37
+ - Bermuda
38
+ - Plurinational State of Bolivia
39
+ - Brazil
40
+ - Barbados
41
+ - Brunei-Darussalam
42
+ - Bhutan
43
+ - Bouvet-Island
44
+ - Botswana
45
+ - Central African Republic
46
+ - Canada
47
+ - Cocos (Keeling) Islands
48
+ - Switzerland
49
+ - Chile
50
+ - China
51
+ - Côte-dIvoire
52
+ - Cameroon
53
+ - Democratic Republic of the Congo
54
+ - Cook Islands
55
+ - Colombia
56
+ - Comoros
57
+ - Cabo Verde
58
+ - Costa Rica
59
+ - Cuba
60
+ - Curaçao
61
+ - Christmas Island
62
+ - Cayman Islands
63
+ - Cyprus
64
+ - Czechia
65
+ - Germany
66
+ - Djibouti
67
+ - Dominica
68
+ - Denmark
69
+ - Dominican Republic
70
+ - Algeria
71
+ - Ecuador
72
+ - Egypt
73
+ - Eritrea
74
+ - Western Sahara
75
+ - Spain
76
+ - Estonia
77
+ - Ethiopia
78
+ - Finland
79
+ - Fiji
80
+ - Falkland Islands (Malvinas)
81
+ - France
82
+ - Faroe Islands
83
+ - Federated States of Micronesia
84
+ - Gabon
85
+ - United Kingdom
86
+ - Georgia
87
+ - Guernsey
88
+ - Ghana
89
+ - Gibraltar
90
+ - Guinea
91
+ - Guadeloupe
92
+ - Gambia
93
+ - Guinea Bissau
94
+ - Equatorial Guinea
95
+ - Greece
96
+ - Grenada
97
+ - Greenland
98
+ - Guatemala
99
+ - French Guiana
100
+ - Guam
101
+ - Guyana
102
+ - Hong Kong
103
+ - Heard Island and McDonald Islands
104
+ - Honduras
105
+ - Croatia
106
+ - Haiti
107
+ - Hungary
108
+ - Indonesia
109
+ - Isle of Man
110
+ - India
111
+ - British Indian Ocean Territory
112
+ - Ireland
113
+ - Islamic Republic of Iran
114
+ - Iraq
115
+ - Iceland
116
+ - Israel
117
+ - Italy
118
+ - Jamaica
119
+ - Jersey
120
+ - Jordan
121
+ - Japan
122
+ - Kazakhstan
123
+ - Kenya
124
+ - Kyrgyzstan
125
+ - Cambodia
126
+ - Kiribati
127
+ - Saint-Kitts-and-Nevis
128
+ - South Korea
129
+ - Kuwait
130
+ - Lao-Peoples-Democratic-Republic
131
+ - Lebanon
132
+ - Liberia
133
+ - Libya
134
+ - Saint-Lucia
135
+ - Liechtenstein
136
+ - Sri Lanka
137
+ - Lesotho
138
+ - Lithuania
139
+ - Luxembourg
140
+ - Latvia
141
+ - Macao
142
+ - Saint Martin (French-part)
143
+ - Morocco
144
+ - Monaco
145
+ - Republic of Moldova
146
+ - Madagascar
147
+ - Maldives
148
+ - Mexico
149
+ - Marshall Islands
150
+ - North Macedonia
151
+ - Mali
152
+ - Malta
153
+ - Myanmar
154
+ - Montenegro
155
+ - Mongolia
156
+ - Northern Mariana Islands
157
+ - Mozambique
158
+ - Mauritania
159
+ - Montserrat
160
+ - Martinique
161
+ - Mauritius
162
+ - Malawi
163
+ - Malaysia
164
+ - Mayotte
165
+ - Namibia
166
+ - New Caledonia
167
+ - Niger
168
+ - Norfolk Island
169
+ - Nigeria
170
+ - Nicaragua
171
+ - Niue
172
+ - Netherlands
173
+ - Norway
174
+ - Nepal
175
+ - Nauru
176
+ - New Zealand
177
+ - Oman
178
+ - Pakistan
179
+ - Panama
180
+ - Pitcairn
181
+ - Peru
182
+ - Philippines
183
+ - Palau
184
+ - Papua New Guinea
185
+ - Poland
186
+ - Puerto Rico
187
+ - North Korea
188
+ - Portugal
189
+ - Paraguay
190
+ - State of Palestine
191
+ - French Polynesia
192
+ - Qatar
193
+ - Réunion
194
+ - Romania
195
+ - Russia
196
+ - Rwanda
197
+ - Saudi Arabia
198
+ - Sudan
199
+ - Senegal
200
+ - Singapore
201
+ - South Georgia and the South Sandwich Islands
202
+ - Saint Helena Ascension and Tristan da Cunha
203
+ - Svalbard and Jan Mayen
204
+ - Solomon Islands
205
+ - Sierra Leone
206
+ - El Salvador
207
+ - San Marino
208
+ - Somalia
209
+ - Saint Pierre and Miquelon
210
+ - Serbia
211
+ - South Sudan
212
+ - Sao Tome and Principe
213
+ - Suriname
214
+ - Slovakia
215
+ - Slovenia
216
+ - Sweden
217
+ - Eswatini
218
+ - Sint Maarten (Dutch-part)
219
+ - Seychelles
220
+ - Syrian Arab Republic
221
+ - Turks and Caicos Islands
222
+ - Chad
223
+ - Togo
224
+ - Thailand
225
+ - Tajikistan
226
+ - Tokelau
227
+ - Turkmenistan
228
+ - Timor Leste
229
+ - Tonga
230
+ - Trinidad and Tobago
231
+ - Tunisia
232
+ - Turkey
233
+ - Tuvalu
234
+ - Taiwan
235
+ - United Republic of Tanzania
236
+ - Uganda
237
+ - Ukraine
238
+ - United States Minor Outlying Islands
239
+ - Uruguay
240
+ - United-States
241
+ - Uzbekistan
242
+ - Holy See (Vatican City State)
243
+ - Saint Vincent and the Grenadines
244
+ - Bolivarian Republic of Venezuela
245
+ - Virgin Islands British
246
+ - Virgin Islands U.S.
247
+ - VietNam
248
+ - Vanuatu
249
+ - Wallis and Futuna
250
+ - Samoa
251
+ - Yemen
252
+ - South Africa
253
+ - Zambia
254
+ - Zimbabwe
255
+ type: select
256
+ I agree to use this model for non-commercial use ONLY: checkbox
257
+ Name: text
258
+ Receive email updates on C4AI and Cohere research, events, products and services?:
259
+ options:
260
+ - Yes
261
+ - No
262
+ type: select
263
+ extra_gated_prompt: By submitting this form, you agree to the [License Agreement](https://cohere.com/c4ai-cc-by-nc-license) and
264
+ acknowledge that the information you provide will be collected, used, and shared
265
+ in accordance with Cohere’s [Privacy Policy]( https://cohere.com/privacy).
266
+ language:
267
+ - en
268
+ - fr
269
+ - de
270
+ - es
271
+ - it
272
+ - pt
273
+ - ja
274
+ - ko
275
+ - zh
276
+ - ar
277
+ library_name: transformers
278
+ license: cc-by-nc-4.0
279
+ quantized_by: mradermacher
280
+ ---
281
+ ## About
282
+
283
  <!-- ### quantize_version: 2 -->
284
  <!-- ### output_tensor_quantised: 1 -->
285
  <!-- ### convert_type: hf -->
286
  <!-- ### vocab_type: -->
287
  <!-- ### tags: -->
288
  static quants of https://huggingface.co/CohereForAI/c4ai-command-r-plus
289
+
290
+ <!-- provided-files -->
291
+ weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
292
+ ## Usage
293
+
294
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
295
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
296
+ more details, including on how to concatenate multi-part files.
297
+
298
+ ## Provided Quants
299
+
300
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
301
+
302
+ | Link | Type | Size/GB | Notes |
303
+ |:-----|:-----|--------:|:------|
304
+ | [GGUF](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q2_K.gguf) | Q2_K | 39.6 | |
305
+ | [GGUF](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.IQ3_S.gguf) | IQ3_S | 46.1 | beats Q3_K* |
306
+ | [PART 1](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q4_K_S.gguf.part1of2) [PART 2](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q4_K_S.gguf.part2of2) | Q4_K_S | 59.7 | fast, recommended |
307
+ | [PART 1](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q8_0.gguf.part1of3) [PART 2](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q8_0.gguf.part2of3) [PART 3](https://huggingface.co/mradermacher/c4ai-command-r-plus-GGUF/resolve/main/c4ai-command-r-plus.Q8_0.gguf.part3of3) | Q8_0 | 110.4 | fast, best quality |
308
+
309
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
310
+ types (lower is better):
311
+
312
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
313
+
314
+ And here are Artefact2's thoughts on the matter:
315
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
316
+
317
+ ## FAQ / Model Request
318
+
319
+ See https://huggingface.co/mradermacher/model_requests for some answers to
320
+ questions you might have and/or if you want some other model quantized.
321
+
322
+ ## Thanks
323
+
324
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
325
+ me use its servers and providing upgrades to my workstation to enable
326
+ this work in my free time.
327
+
328
+ <!-- end -->