kromeurus commited on
Commit
534199b
1 Parent(s): 97d942a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +47 -45
README.md CHANGED
@@ -1,45 +1,47 @@
1
- ---
2
- base_model:
3
- - kromeurus/L3-Blackened-Sunfall-15B
4
- - ZeusLabs/L3-Aethora-15B-V2
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - merge
9
-
10
- ---
11
- # merge
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [kromeurus/L3-Blackened-Sunfall-15B](https://huggingface.co/kromeurus/L3-Blackened-Sunfall-15B) as a base.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [ZeusLabs/L3-Aethora-15B-V2](https://huggingface.co/ZeusLabs/L3-Aethora-15B-V2)
24
-
25
- ### Configuration
26
-
27
- The following YAML configuration was used to produce this model:
28
-
29
- ```yaml
30
-
31
- models:
32
- - model: kromeurus/L3-Blackened-Sunfall-15B
33
- # No parameters necessary for base model
34
- - model: ZeusLabs/L3-Aethora-15B-V2
35
- parameters:
36
- density: [0.25, 0.46, 0.57, 0.38, 0.19]
37
- weight: 0.8
38
- merge_method: ties
39
- base_model: kromeurus/L3-Blackened-Sunfall-15B
40
- parameters:
41
- normalize: true
42
- int8_mask: true
43
- dtype: bfloat16
44
-
45
- ```
 
 
 
1
+ ---
2
+ base_model:
3
+ - kromeurus/L3-Blackened-Sunfall-15B
4
+ - ZeusLabs/L3-Aethora-15B-V2
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ - not-for-all-audiences
10
+ license: cc-by-sa-4.0
11
+ ---
12
+
13
+ ## Merge Details
14
+
15
+
16
+
17
+ ### Merge Method
18
+
19
+ This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method.
20
+
21
+ ### Models Merged
22
+
23
+ The following models were included in the merge:
24
+ * [ZeusLabs/L3-Aethora-15B-V2](https://huggingface.co/ZeusLabs/L3-Aethora-15B-V2)
25
+ * [kromeurus/L3-Blackened-Sunfall-15B](https://huggingface.co/kromeurus/L3-Blackened-Sunfall-15B) as a base.
26
+
27
+ ### Configuration
28
+
29
+ The following YAML configuration was used to produce this model:
30
+
31
+ ```yaml
32
+
33
+ models:
34
+ - model: kromeurus/L3-Blackened-Sunfall-15B
35
+ # No parameters necessary for base model
36
+ - model: ZeusLabs/L3-Aethora-15B-V2
37
+ parameters:
38
+ density: [0.25, 0.46, 0.57, 0.38, 0.19]
39
+ weight: 0.8
40
+ merge_method: ties
41
+ base_model: kromeurus/L3-Blackened-Sunfall-15B
42
+ parameters:
43
+ normalize: true
44
+ int8_mask: true
45
+ dtype: bfloat16
46
+
47
+ ```