appvoid commited on
Commit
90345bc
1 Parent(s): 9cf12fd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -30
README.md CHANGED
@@ -9,12 +9,7 @@ tags:
9
  - merge
10
 
11
  ---
12
- # merge
13
-
14
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
-
16
- ## Merge Details
17
- ### Merge Method
18
 
19
  This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [appvoid/palmer-002-32k](https://huggingface.co/appvoid/palmer-002-32k) as a base.
20
 
@@ -22,27 +17,4 @@ This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge m
22
 
23
  The following models were included in the merge:
24
  * [raidhon/coven_tiny_1.1b_32k_orpo_alpha](https://huggingface.co/raidhon/coven_tiny_1.1b_32k_orpo_alpha)
25
- * [appvoid/palmer-003](https://huggingface.co/appvoid/palmer-003)
26
-
27
- ### Configuration
28
-
29
- The following YAML configuration was used to produce this model:
30
-
31
- ```yaml
32
- models:
33
- - model: appvoid/palmer-003
34
- parameters:
35
- density: 0.5
36
- weight: 0.5
37
- - model: raidhon/coven_tiny_1.1b_32k_orpo_alpha
38
- parameters:
39
- density: 0.5
40
- weight: 0.5
41
-
42
- merge_method: ties
43
- base_model: appvoid/palmer-002-32k
44
- parameters:
45
- normalize: false
46
- int8_mask: true
47
- dtype: float16
48
- ```
 
9
  - merge
10
 
11
  ---
12
+ # palmer
 
 
 
 
 
13
 
14
  This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [appvoid/palmer-002-32k](https://huggingface.co/appvoid/palmer-002-32k) as a base.
15
 
 
17
 
18
  The following models were included in the merge:
19
  * [raidhon/coven_tiny_1.1b_32k_orpo_alpha](https://huggingface.co/raidhon/coven_tiny_1.1b_32k_orpo_alpha)
20
+ * [appvoid/palmer-003](https://huggingface.co/appvoid/palmer-003)