shuyuej commited on
Commit
056ea38
1 Parent(s): 94cfd30

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -2,6 +2,13 @@
2
  license: apache-2.0
3
  ---
4
 
 
 
 
 
 
 
 
5
  ```text
6
  "quantization_config": {
7
  "batch_size": 1,
@@ -28,3 +35,5 @@ license: apache-2.0
28
  "use_exllama": true
29
  },
30
  ```
 
 
 
2
  license: apache-2.0
3
  ---
4
 
5
+ # The Quantized Command R Model
6
+
7
+ Original Base Model: `CohereForAI/c4ai-command-r-plus`.<br>
8
+ Link: [https://huggingface.co/CohereForAI/c4ai-command-r-plus](https://huggingface.co/CohereForAI/c4ai-command-r-plus)
9
+
10
+ Quantization Configurations:
11
+
12
  ```text
13
  "quantization_config": {
14
  "batch_size": 1,
 
35
  "use_exllama": true
36
  },
37
  ```
38
+
39
+ Souce Codes: [https://github.com/vkola-lab/medpodgpt/tree/main/quantization](https://github.com/vkola-lab/medpodgpt/tree/main/quantization).