Update README.md
Browse files
README.md
CHANGED
|
@@ -19,6 +19,9 @@ base_model:
|
|
| 19 |
|
| 20 |
# MixtureofMerges-MoE-v2
|
| 21 |
|
|
|
|
|
|
|
|
|
|
| 22 |
MixtureofMerges-MoE-v2 is a Mixure of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
| 23 |
* [mlabonne/NeuralBeagle14-7B](https://huggingface.co/mlabonne/NeuralBeagle14-7B)
|
| 24 |
* [jsfs11/TurdusTrixBeagle-DARETIES-7B](https://huggingface.co/jsfs11/TurdusTrixBeagle-DARETIES-7B)
|
|
|
|
| 19 |
|
| 20 |
# MixtureofMerges-MoE-v2
|
| 21 |
|
| 22 |
+
Credit to [CultriX/Wernicke-MoE](https://huggingface.co/CultriX/Wernicke-MoE) for the inspiration on this model.
|
| 23 |
+
I'm quite pleased with how it turned out.
|
| 24 |
+
|
| 25 |
MixtureofMerges-MoE-v2 is a Mixure of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
| 26 |
* [mlabonne/NeuralBeagle14-7B](https://huggingface.co/mlabonne/NeuralBeagle14-7B)
|
| 27 |
* [jsfs11/TurdusTrixBeagle-DARETIES-7B](https://huggingface.co/jsfs11/TurdusTrixBeagle-DARETIES-7B)
|