|
--- |
|
tags: |
|
- not-for-all-audiences |
|
- nsfw |
|
license: other |
|
language: |
|
- en |
|
--- |
|
|
|
[EXL2](https://github.com/turboderp/exllamav2/tree/master#exllamav2) Quantization of [Undi95's's Xwin-MLewd-13B-V0.2](https://huggingface.co/Undi95/Xwin-MLewd-13B-V0.2). |
|
|
|
|
|
## Model details |
|
|
|
Quantized at 5.33bpw |
|
|
|
[3.73bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/3bit) |
|
|
|
[4.33bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/4bit) |
|
|
|
[6.13bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/6bit) |
|
|
|
[8.13bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/8bit) |
|
|
|
## Prompt Format |
|
|
|
``` |
|
Below is an instruction that describes a task. Write a response that appropriately completes the request. |
|
|
|
### Instruction: |
|
{prompt} |
|
|
|
### Response: |
|
|
|
``` |
