Tinyllama-moe3 / mergekit_moe_config.yml
aipib's picture
Upload folder using huggingface_hub
a3a2d1d verified
raw
history blame
344 Bytes
base_model: vihangd/DopeyTinyLlama-1.1B-v1
experts:
- source_model: vihangd/DopeyTinyLlama-1.1B-v1
positive_prompts:
- "chat"
- "assistant"
- "tell me"
- "explain"
- source_model: Tensoic/TinyLlama-1.1B-3T-openhermes
positive_prompts:
- "reason"
- "provide"
- "instruct"
- "summarize"
- "count"