MrRobotoAI/Hathor-v4

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using MrRobotoAI/Hathor-v3.1 as a base.

Models Merged

The following models were included in the merge:

• MrRobotoAI/Hathor-v3.1 + Azazelle/Llama-3-Instruct-LiPPA-LoRA-8B
• MrRobotoAI/Hathor-v3.1 + ResplendentAI/Aura_Llama3
• MrRobotoAI/Hathor-v3.1 + ResplendentAI/BlueMoon_Llama3
• MrRobotoAI/Hathor-v3.1 + ResplendentAI/Luna_Llama3
• MrRobotoAI/Hathor-v3.1 + ResplendentAI/Theory_of_Mind_Llama3
• MrRobotoAI/Hathor-v3.1 + Azazelle/Smarts_Llama3
• MrRobotoAI/Hathor-v3.1 + Azazelle/Nimue-8B
• MrRobotoAI/Hathor-v3.1 + Blackroot/Llama-3-LongStory-LORA
• MrRobotoAI/Hathor-v3.1 + Azazelle/L3-Daybreak-8b-lora
• MrRobotoAI/Hathor-v3.1 + Azazelle/Llama-3-LongStory-LORA
• MrRobotoAI/Hathor-v3.1 + ResplendentAI/NoWarning_Llama3
• MrRobotoAI/Hathor-v3.1 + Azazelle/Llama-3-8B-Abomination-LORA
• MrRobotoAI/Hathor-v3.1 + Azazelle/Llama-3-LimaRP-Instruct-LoRA-8B

Configuration

The following YAML configuration was used to produce this model:

models:

  - model: MrRobotoAI/Hathor-v3.1+Azazelle/Llama-3-8B-Abomination-LORA
  - model: MrRobotoAI/Hathor-v3.1+Azazelle/Llama-3-LimaRP-Instruct-LoRA-8B
  - model: MrRobotoAI/Hathor-v3.1+Azazelle/Llama-3-LongStory-LORA
  - model: MrRobotoAI/Hathor-v3.1+Azazelle/Smarts_Llama3
  - model: MrRobotoAI/Hathor-v3.1+Azazelle/Nimue-8B
  - model: MrRobotoAI/Hathor-v3.1+Azazelle/Llama-3-Instruct-LiPPA-LoRA-8B
  - model: MrRobotoAI/Hathor-v3.1+Azazelle/L3-Daybreak-8b-lora
  - model: MrRobotoAI/Hathor-v3.1+ResplendentAI/Theory_of_Mind_Llama3
  - model: MrRobotoAI/Hathor-v3.1+ResplendentAI/Aura_Llama3
  - model: MrRobotoAI/Hathor-v3.1+ResplendentAI/Luna_Llama3
  - model: MrRobotoAI/Hathor-v3.1+ResplendentAI/BlueMoon_Llama3
  - model: MrRobotoAI/Hathor-v3.1+ResplendentAI/NoWarning_Llama3
  - model: MrRobotoAI/Hathor-v3.1+Blackroot/Llama-3-LongStory-LORA

merge_method: model_stock
base_model: MrRobotoAI/Hathor-v3.1
normalize: true
dtype: float16