README.md

metadata

base_model: R136a1/InfinityLake-2x7B
language:
  - en
license: apache-2.0
tags:
  - safetensors
  - mixtral
  - not-for-all-audiences
  - nsfw
  - quantized
  - 4-bit
  - AWQ
  - autotrain_compatible
  - endpoints_compatible
  - text-generation-inference
inference: false
prompt_template: |
  <|im_start|>system
  {system_message}<|im_end|>
  <|im_start|>user
  {prompt}<|im_end|>
  <|im_start|>assistant
quantized_by: Suparious

R136a1/InfinityLake-2x7B AWQ

• Model creator: R136a1
• Original model: InfinityLake-2x7B

Model Summary

Experimental model from Endevor/InfinityRP-v1-7B and senseable/WestLake-7B-v2 models. Merged to MoE model with 2x7B parameters.