File size: 359 Bytes
8416893
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
# Mergekit test 1

> This is completely experimental, I don't even know if this works (probably not)

Running https://github.com/cg123/mergekit with these config:

```yaml
models:
  - model: EleutherAI/llemma_7b
    parameters:
      weight: 1.0
  - model: ehartford/dolphin-llama2-7b
    parameters:
      weight: 0.2
merge_method: linear
dtype: float16
```