File size: 842 Bytes
887e5e2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- KoboldAI/LLaMA2-13B-Psyfighter2
- NeverSleep/Noromaid-13b-v0.2
---

# NoroFighter-13B-v0.1a

Our very first attempt at merging models!


`NoroFighter-13B-v0.1a` is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
* [KoboldAI/LLaMA2-13B-Psyfighter2](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2)
* [NeverSleep/Noromaid-13b-v0.2](https://huggingface.co/NeverSleep/Noromaid-13b-v0.2)

## 🧩 Configuration

```yaml
merge_method: dare_ties
dtype: float16
base_model: TheBloke/Llama-2-13B-fp16
models:
  - model: TheBloke/Llama-2-13B-fp16
  - model: KoboldAI/LLaMA2-13B-Psyfighter2
    parameters:
      weight: 0.3
      density: 0.53
  - model: NeverSleep/Noromaid-13b-v0.2
    parameters:
      weight: 0.7
      density: 0.53

```