--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - NousResearch/Hermes-3-Llama-3.1-8B - akjindal53244/Llama-3.1-Storm-8B --- # llama3.1-8b-h3storm llama3.1-8b-h3storm is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B) * [akjindal53244/Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B) ## 🧩 Configuration ```yaml slices: - sources: - model: NousResearch/Hermes-3-Llama-3.1-8B layer_range: - 0 - 32 - model: akjindal53244/Llama-3.1-Storm-8B layer_range: - 0 - 32 merge_method: slerp base_model: NousResearch/Hermes-3-Llama-3.1-8B parameters: t: - filter: self_attn value: - 0 - 0.5 - 0.3 - 0.7 - 1 - filter: mlp value: - 1 - 0.5 - 0.7 - 0.3 - 0 - value: 0.5 dtype: float16 ```