Update README.md
Browse files
README.md
CHANGED
|
@@ -44,6 +44,7 @@ The following models were included in the merge:
|
|
| 44 |
The following YAML configuration was used to produce this model:
|
| 45 |
|
| 46 |
```yaml
|
|
|
|
| 47 |
models:
|
| 48 |
- model: Sao10K/MN-12B-Lyra-v1
|
| 49 |
parameters:
|
|
@@ -68,7 +69,7 @@ parameters:
|
|
| 68 |
epsilon: 0.05
|
| 69 |
lambda: 1
|
| 70 |
dtype: bfloat16
|
| 71 |
-
|
| 72 |
models:
|
| 73 |
- model: BeaverAI/mistral-doryV2-12b
|
| 74 |
parameters:
|
|
@@ -97,7 +98,7 @@ parameters:
|
|
| 97 |
epsilon: 0.05
|
| 98 |
lambda: 1
|
| 99 |
dtype: bfloat16
|
| 100 |
-
|
| 101 |
slices:
|
| 102 |
- sources:
|
| 103 |
- model: v000000/MN-12B-Part2
|
|
|
|
| 44 |
The following YAML configuration was used to produce this model:
|
| 45 |
|
| 46 |
```yaml
|
| 47 |
+
#Step 1
|
| 48 |
models:
|
| 49 |
- model: Sao10K/MN-12B-Lyra-v1
|
| 50 |
parameters:
|
|
|
|
| 69 |
epsilon: 0.05
|
| 70 |
lambda: 1
|
| 71 |
dtype: bfloat16
|
| 72 |
+
#Step 2
|
| 73 |
models:
|
| 74 |
- model: BeaverAI/mistral-doryV2-12b
|
| 75 |
parameters:
|
|
|
|
| 98 |
epsilon: 0.05
|
| 99 |
lambda: 1
|
| 100 |
dtype: bfloat16
|
| 101 |
+
#Step 3
|
| 102 |
slices:
|
| 103 |
- sources:
|
| 104 |
- model: v000000/MN-12B-Part2
|