R136a1 commited on
Commit
c43e9cc
1 Parent(s): 7061f82

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - not-for-all-audiences
4
+ - nsfw
5
+ license: other
6
+ language:
7
+ - en
8
+ ---
9
+
10
+ [EXL2](https://github.com/turboderp/exllamav2/tree/master#exllamav2) Quantization of [Undi95's's MLewd-ReMM-L2-Chat-20B](https://huggingface.co/Undi95/MLewd-ReMM-L2-Chat-20B).
11
+
12
+
13
+ ## Model details
14
+
15
+ Quantized at 3.23bpw with hb 8
16
+
17
+ Perplexity:
18
+
19
+ Base = 6.5820
20
+
21
+ 3.23 h8 = 6.6758
22
+
23
+ Dataset = [wikitext](https://huggingface.co/datasets/wikitext/resolve/refs%2Fconvert%2Fparquet/wikitext-2-v1/test/0000.parquet)
24
+
25
+ ## Prompt Format
26
+
27
+ ```
28
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
29
+
30
+ ### Instruction:
31
+ {prompt}
32
+
33
+ ### Response:
34
+
35
+ ```