| base_model: R136a1/InfinityLake-2x7B | |
| language: | |
| - en | |
| license: apache-2.0 | |
| tags: | |
| - safetensors | |
| - mixtral | |
| - not-for-all-audiences | |
| - nsfw | |
| - quantized | |
| - 4-bit | |
| - AWQ | |
| - autotrain_compatible | |
| - endpoints_compatible | |
| - text-generation-inference | |
| inference: false | |
| prompt_template: | | |
| <|im_start|>system | |
| {system_message}<|im_end|> | |
| <|im_start|>user | |
| {prompt}<|im_end|> | |
| <|im_start|>assistant | |
| quantized_by: Suparious | |
| # R136a1/InfinityLake-2x7B AWQ | |
| - Model creator: [R136a1](https://huggingface.co/R136a1) | |
| - Original model: [InfinityLake-2x7B](https://huggingface.co/R136a1/InfinityLake-2x7B) | |
|  | |
| ## Model Summary | |
| Experimental model from [Endevor/InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B) and [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2) models. Merged to MoE model with 2x7B parameters. | |