Mergekit test 1
This is completely experimental, I don't even know if this works (probably not)
Running https://github.com/cg123/mergekit with these config:
models:
- model: EleutherAI/llemma_7b
parameters:
weight: 1.0
- model: ehartford/dolphin-llama2-7b
parameters:
weight: 0.2
merge_method: linear
dtype: float16