--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - Qwen/Qwen2-7B --- # gemma-2-13b-it gemma-2-13b-it is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) * [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) * [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) * [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) * [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) * [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) ## 🧩 Configuration ```yaml dtype: bfloat16 merge_method: passthrough slices: - sources: - layer_range: [0, 8] model: Qwen/Qwen2-7B - sources: - layer_range: [4, 12] model: Qwen/Qwen2-7B - sources: - layer_range: [8, 16] model: Qwen/Qwen2-7B - sources: - layer_range: [12, 20] model: Qwen/Qwen2-7B - sources: - layer_range: [16, 24] model: Qwen/Qwen2-7B - sources: - layer_range: [20, 28] model: Qwen/Qwen2-7B ```