--- base_model: - anthracite-org/magnum-12b-v2.5-kto - nothingiisreal/MN-12B-Celeste-V1.9 library_name: transformers tags: - mergekit - merge --- # Unofficial continuation of [aetherwiing's](https://huggingface.co/aetherwiing) "Starcannon" series static quants at: https://huggingface.co/mradermacher/MN-12B-Starcannon-v4-unofficial-GGUF imatrix quants at: https://huggingface.co/mradermacher/MN-12B-Starcannon-v4-unofficial-i1-GGUF # mergedmodel This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [nothingiisreal/MN-12B-Celeste-V1.9](https://huggingface.co/nothingiisreal/MN-12B-Celeste-V1.9) as a base. ### Models Merged The following models were included in the merge: * [anthracite-org/magnum-12b-v2.5-kto](https://huggingface.co/anthracite-org/magnum-12b-v2.5-kto) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: anthracite-org/magnum-12b-v2.5-kto parameters: density: 0.3 weight: 0.5 - model: nothingiisreal/MN-12B-Celeste-V1.9 parameters: density: 0.7 weight: 0.5 merge_method: ties base_model: nothingiisreal/MN-12B-Celeste-V1.9 parameters: normalize: true int8_mask: true dtype: bfloat16 ```