Turkish-moe / README.md
burak's picture
Upload folder using huggingface_hub
30b997b verified
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit

Turkish-moe

Turkish-moe is a merge of the following models using mergekit:

🧩 Configuration

base_model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0
dtype: float16
gate_mode: cheap_embed
experts:
  - source_model: TURKCELL/Turkcell-LLM-7b-v1
    positive_prompts: ["You are an helpful general-pupose assistant."]
  - source_model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0
    positive_prompts: ["You are helpful assistant."]