mergekit-test-1 / README.md
lemonteaa's picture
Create README.md
8416893
|
raw
history blame
359 Bytes

Mergekit test 1

This is completely experimental, I don't even know if this works (probably not)

Running https://github.com/cg123/mergekit with these config:

models:
  - model: EleutherAI/llemma_7b
    parameters:
      weight: 1.0
  - model: ehartford/dolphin-llama2-7b
    parameters:
      weight: 0.2
merge_method: linear
dtype: float16