R136a1
/

MLewd-ReMM-L2-Chat-20B-exl2

Text Generation

Not-For-All-Audiences

nsfw

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

R136a1 commited on Oct 17, 2023

Commit

fd8c2ba

•

1 Parent(s): 16da046

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -12,13 +12,13 @@ language:
 ## Model details
-Quantized at 3.23bpw with hb 8
 Perplexity:
 Base = 6.5820
-3.23 h8 = 6.6758
 Dataset = [wikitext](https://huggingface.co/datasets/wikitext/resolve/refs%2Fconvert%2Fparquet/wikitext-2-v1/test/0000.parquet)

 ## Model details
+Quantized at 3.18bpw with hb 6. Can run full 4K context on 16GB VRAM
 Perplexity:
 Base = 6.5820
+3.18 h6 = 6.6928
 Dataset = [wikitext](https://huggingface.co/datasets/wikitext/resolve/refs%2Fconvert%2Fparquet/wikitext-2-v1/test/0000.parquet)