shuyuej commited on
Commit
e8b5a95
1 Parent(s): 4076594

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -3
README.md CHANGED
@@ -1,3 +1,29 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ # The Quantized Alibaba-NLP gte-Qwen1.5-7B-instruct Model
6
+
7
+ Original Base Embedding Model: `Alibaba-NLP/gte-Qwen1.5-7B-instruct`.<br>
8
+ Link: [https://huggingface.co/Alibaba-NLP/gte-Qwen1.5-7B-instruct](https://huggingface.co/Alibaba-NLP/gte-Qwen1.5-7B-instruct)
9
+
10
+ ## Quantization Configurations
11
+
12
+ ```text
13
+ "quantization_config": {
14
+ "bits": 4,
15
+ "checkpoint_format": "gptq",
16
+ "damp_percent": 0.01,
17
+ "desc_act": true,
18
+ "group_size": 128,
19
+ "model_file_base_name": null,
20
+ "model_name_or_path": null,
21
+ "quant_method": "gptq",
22
+ "static_groups": false,
23
+ "sym": true,
24
+ "true_sequential": true
25
+ },
26
+ ```
27
+
28
+ ## Source Codes
29
+ Source Codes: [https://github.com/vkola-lab/medpodgpt/tree/main/quantization](https://github.com/vkola-lab/medpodgpt/tree/main/quantization).