Hugging Face's logo

solidrust
/
RainyMotip-2x7B-AWQ

Text Generation
Transformers
Safetensors
mixtral
4-bit precision
AWQ
Inference Endpoints
Mixture of Experts
Merge
text-generation-inference
awq
Model card Files Community
Edit model card

Alsebay/RainyMotip-2x7B AWQ

Model Summary

What is it? A 2x7B MoE model for Roleplay(?).

You will occur GPT-like responses sometimes, just skip it and reroll (gacha time). Overall, I think it good enough for Roleplaying.

You may want see this: https://huggingface.co/Alsebay/My_LLMs_Leaderboard

This model is is a Mixure of Experts (MoE) made with the following models:

  • udkai/Turdus
  • Kquant03/Samlagast-7B-laser-bf16

If you used it, please let me know if it good or not. Thank you :)

Downloads last month
10
Safetensors
Model size
1.95B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.

Model tree for solidrust/RainyMotip-2x7B-AWQ

Base model

Alsebay/RainyMotip-2x7B
Quantized
(2)
this model

Collection including solidrust/RainyMotip-2x7B-AWQ