Hugging Face's logo

solidrust
/
InfinityLake-2x7B-AWQ

Text Generation
Transformers
Safetensors
English
mixtral
Not-For-All-Audiences
nsfw
quantized
4-bit precision
AWQ
Inference Endpoints
text-generation-inference
awq
Model card Files Community
Edit model card

R136a1/InfinityLake-2x7B AWQ

InfinityKuno-2x7B

Model Summary

Experimental model from Endevor/InfinityRP-v1-7B and senseable/WestLake-7B-v2 models. Merged to MoE model with 2x7B parameters.

Downloads last month
12
Safetensors
Model size
1.95B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.

Model tree for solidrust/InfinityLake-2x7B-AWQ

Base model

R136a1/InfinityLake-2x7B
Quantized
(1)
this model

Collection including solidrust/InfinityLake-2x7B-AWQ