Commit
•
48f445c
1
Parent(s):
6fc7ebf
Update README.md
Browse filesSlight clarification of merge method
README.md
CHANGED
|
@@ -179,6 +179,7 @@ I recommend consulting with legal counsel to ensure your use of this model compl
|
|
| 179 |
### Merge Method
|
| 180 |
|
| 181 |
I found della_linear to be the most effective method for merging a Llama 3 model with Llama 3.1 out of a dozen or so different tests.
|
|
|
|
| 182 |
|
| 183 |
### Configuration
|
| 184 |
|
|
|
|
| 179 |
### Merge Method
|
| 180 |
|
| 181 |
I found della_linear to be the most effective method for merging a Llama 3 model with Llama 3.1 out of a dozen or so different tests.
|
| 182 |
+
You can apply a higher density setting for sure. I went up to 0.5 density with an epsilon of 0.1 without any problems, and you could probably go higher than that, but I think this version with the lower density came out a little smarter and worked better for this particular pairing.
|
| 183 |
|
| 184 |
### Configuration
|
| 185 |
|