Hugging Face's logo

solidrust
/
InfinityLake-2x7B-AWQ

Text Generation
Transformers
Safetensors
English
mixtral
Not-For-All-Audiences
nsfw
quantized
4-bit precision
AWQ
Inference Endpoints
text-generation-inference
awq
Model card Files Community
InfinityLake-2x7B-AWQ
File size: 1,043 Bytes 
b128172
e8cbfa1
b128172
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
 
---
base_model: R136a1/InfinityLake-2x7B
language:
- en
license: apache-2.0
tags:
- safetensors
- mixtral
- not-for-all-audiences
- nsfw
- quantized
- 4-bit
- AWQ
- autotrain_compatible
- endpoints_compatible
- text-generation-inference
inference: false
prompt_template: |
  <|im_start|>system
  {system_message}<|im_end|>
  <|im_start|>user
  {prompt}<|im_end|>
  <|im_start|>assistant
quantized_by: Suparious
---
# R136a1/InfinityLake-2x7B AWQ

- Model creator: [R136a1](https://huggingface.co/R136a1)
- Original model: [InfinityLake-2x7B](https://huggingface.co/R136a1/InfinityLake-2x7B)

![InfinityKuno-2x7B](https://cdn.discordapp.com/attachments/843160171676565508/1228595930433978378/ey.png?ex=662c9e20&is=661a2920&hm=79fcc8417172a9a01f2d7436a4495fe8071e1f3e6f0a8e4decbeebb461acc3b7&)


## Model Summary

Experimental model from [Endevor/InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B) and [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2) models. Merged to MoE model with 2x7B parameters.