Update README.md
Browse files
README.md
CHANGED
@@ -2,6 +2,13 @@
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
```text
|
6 |
"quantization_config": {
|
7 |
"batch_size": 1,
|
@@ -28,3 +35,5 @@ license: apache-2.0
|
|
28 |
"use_exllama": true
|
29 |
},
|
30 |
```
|
|
|
|
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
+
# The Quantized Command R Model
|
6 |
+
|
7 |
+
Original Base Model: `CohereForAI/c4ai-command-r-plus`.<br>
|
8 |
+
Link: [https://huggingface.co/CohereForAI/c4ai-command-r-plus](https://huggingface.co/CohereForAI/c4ai-command-r-plus)
|
9 |
+
|
10 |
+
Quantization Configurations:
|
11 |
+
|
12 |
```text
|
13 |
"quantization_config": {
|
14 |
"batch_size": 1,
|
|
|
35 |
"use_exllama": true
|
36 |
},
|
37 |
```
|
38 |
+
|
39 |
+
Souce Codes: [https://github.com/vkola-lab/medpodgpt/tree/main/quantization](https://github.com/vkola-lab/medpodgpt/tree/main/quantization).
|