--- base_model: - Undi95/MXLewd-L2-20B - Undi95/PsyMedRP-v1-20B library_name: transformers tags: - mergekit - merge --- # merge PsyMedLewd (A merge of two of my favourite models for scifi stories) ![Warning: Cute alien girls inside!](https://huggingface.co/Elfrino/PsyMedLewd/raw/main/redgirl2.jpg) This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the SLERP merge method. ### Models Merged The following models were included in the merge: * [Undi95/MXLewd-L2-20B](https://huggingface.co/Undi95/MXLewd-L2-20B) * [Undi95/PsyMedRP-v1-20B](https://huggingface.co/Undi95/PsyMedRP-v1-20B) ### Configuration The following YAML configuration was used to produce this model: ```yaml slices: - sources: - model: Undi95/PsyMedRP-v1-20B layer_range: [0, 62] # PsyMedRP has 62 layers - model: Undi95/MXLewd-L2-20B layer_range: [0, 62] # MXLewd has 62 layers merge_method: slerp # Or use another method like weight_average if needed base_model: Undi95/MXLewd-L2-20B # Can use either as the base model parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] # Tune these for desired effect - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.5 # Default averaging weight dtype: bfloat16 # Use preferred dtype, like fp16 or float32 if needed ```