jiayihao03 commited on
Commit
240bea2
1 Parent(s): 808da50

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - jiayihao03/gemma2b_code_javascript_4bit
8
+ - jiayihao03/gemma2b_code_java
9
+ - jiayihao03/gemma_2b_code_python_4bit
10
+ ---
11
+
12
+ # Gemma-2B-ties
13
+
14
+ Gemma-2B-ties is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
15
+ * [jiayihao03/gemma2b_code_javascript_4bit](https://huggingface.co/jiayihao03/gemma2b_code_javascript_4bit)
16
+ * [jiayihao03/gemma2b_code_java](https://huggingface.co/jiayihao03/gemma2b_code_java)
17
+ * [jiayihao03/gemma_2b_code_python_4bit](https://huggingface.co/jiayihao03/gemma_2b_code_python_4bit)
18
+
19
+ ## 🧩 Configuration
20
+
21
+ ```yaml
22
+ models:
23
+ - model: unsloth/gemma-2b-bnb-4bit
24
+ # no parameters necessary for base model
25
+ - model: jiayihao03/gemma2b_code_javascript_4bit
26
+ parameters:
27
+ density: 0.5
28
+ weight: 0.3
29
+ - model: jiayihao03/gemma2b_code_java
30
+ parameters:
31
+ density: 0.5
32
+ weight: 0.3
33
+ - model: jiayihao03/gemma_2b_code_python_4bit
34
+ parameters:
35
+ density: 0.5
36
+ weight: 0.3
37
+ merge_method: ties
38
+ base_model: unsloth/gemma-2b-bnb-4bit
39
+ parameters:
40
+ normalize: true
41
+ dtype: float16
42
+ ```