ZeproSolar-2x7B / mergekit_moe_config.yml
mavihsrr's picture
Upload folder using huggingface_hub
6f4357f verified
raw
history blame contribute delete
No virus
319 Bytes
base_model: NousResearch/Hermes-2-Pro-Mistral-7B
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: HuggingFaceH4/zephyr-7b-beta
positive_prompts: ["You are a helpful assistant."]
- source_model: NousResearch/Nous-Hermes-2-SOLAR-10.7B
positive_prompts: ["You are a general purpose assistant."]