lucyknada commited on
Commit
345462d
1 Parent(s): 9f44d47

Upload ./README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +53 -0
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - anthracite-core/magnum-v3-27b-kto-r3
4
+ - anthracite-core/magnum-v3-27b-KTO-e1-r2
5
+ - anthracite-core/magnum-v3-27b-KTO-e0.25-r1
6
+ - IntervitensInc/gemma-2-27b-chatml
7
+ library_name: transformers
8
+ tags:
9
+ - mergekit
10
+ - merge
11
+
12
+ ---
13
+ ### exl2 quant (measurement.json in main branch)
14
+ ---
15
+ ### check revisions for quants
16
+ ---
17
+
18
+ # output8
19
+
20
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
21
+
22
+ ## Merge Details
23
+ ### Merge Method
24
+
25
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [IntervitensInc/gemma-2-27b-chatml](https://huggingface.co/IntervitensInc/gemma-2-27b-chatml) as a base.
26
+
27
+ ### Models Merged
28
+
29
+ The following models were included in the merge:
30
+ * [anthracite-core/magnum-v3-27b-kto-r3](https://huggingface.co/anthracite-core/magnum-v3-27b-kto-r3)
31
+ * [anthracite-core/magnum-v3-27b-KTO-e1-r2](https://huggingface.co/anthracite-core/magnum-v3-27b-KTO-e1-r2)
32
+ * [anthracite-core/magnum-v3-27b-KTO-e0.25-r1](https://huggingface.co/anthracite-core/magnum-v3-27b-KTO-e0.25-r1)
33
+
34
+ ### Configuration
35
+
36
+ The following YAML configuration was used to produce this model:
37
+
38
+ ```yaml
39
+ base_model: IntervitensInc/gemma-2-27b-chatml
40
+ dtype: float32
41
+ merge_method: task_arithmetic
42
+ models:
43
+ - model: IntervitensInc/gemma-2-27b-chatml
44
+ - model: anthracite-core/magnum-v3-27b-KTO-e0.25-r1
45
+ parameters:
46
+ weight: 0.5
47
+ - model: anthracite-core/magnum-v3-27b-KTO-e1-r2
48
+ parameters:
49
+ weight: 0.1
50
+ - model: anthracite-core/magnum-v3-27b-kto-r3
51
+ parameters:
52
+ weight: 0.4
53
+ ```