File size: 3,535 Bytes
556fdcd
 
b3abb8e
 
556fdcd
 
b3abb8e
 
 
 
 
 
 
 
 
556fdcd
d8e8a2a
 
6d745f7
 
 
 
 
 
 
 
 
556fdcd
 
 
 
 
e5bc00a
556fdcd
3870ec9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6d745f7
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
---
license: apache-2.0
language:
- en
---

<div align="center">
  <b style="font-size: 40px;">Impish_LLAMA_3B</b>


</div>


<img src="IMAGE_GOES_HERE" alt="Dusk Impish_LLAMA_3B" style="width: 70%; min-width: 500px; display: block; margin: auto;">


"With that naughty impish grin of hers, so damn sly it could have ensnared the devil himself, and that impish glare in her eyes, sharper than of a succubus fang, she chuckled impishly with such mischief that even the moon might’ve blushed. I needed no witch's hex to divine her nature—she was, without a doubt, a naughty little imp."

# Model Details


- Censorship level: <b>Low</b>

- PENDING / 10 (10 completely uncensored)

- Intended use: **Role-Play**, General tasks.


## Impish_LLAMA_3B is available at the following quantizations:

- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B)
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_GGUF) | [iMatrix_GGUF](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_iMatrix)
- EXL2: [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-4.0bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-5.0bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-8.0bpw)
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_FP8)
- Mobile (ARM): [Q4_0_X_X](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B_ARM)






# Model instruction template: Llama-3-Instruct

```
<|begin_of_text|><|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>

{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{output}<|eot_id|>
```

**Recommended generation Presets:**

<details>
<summary><b>Midnight Enigma</b></summary>
  max_new_tokens: 512

  temperature: 0.98
  
  top_p: 0.37
  
  top_k: 100
  
  typical_p: 1
  
  min_p: 0
  
  repetition_penalty: 1.18
  
  do_sample: True

</details>

<details>
<summary><b>min_p</b></summary>
  max_new_tokens: 512

  temperature: 1
  
  top_p: 1
  
  top_k: 0
  
  typical_p: 1
  
  min_p: 0.05
  
  repetition_penalty: 1
  
  do_sample: True

</details>

<details>
<summary><b>Divine Intellect</b></summary>
  max_new_tokens: 512

  temperature: 1.31
  
  top_p: 0.14
  
  top_k: 49
  
  typical_p: 1
  
  min_p: 0
  
  repetition_penalty: 1.17
  
  do_sample: True

</details>

<details>
<summary><b>simple-1</b></summary>
  max_new_tokens: 512

  temperature: 0.7
  
  top_p: 0.9
  
  top_k: 20
  
  typical_p: 1
  
  min_p: 0
  
  repetition_penalty: 1.15
  
  do_sample: True

</details>



### Support
<img src="https://i.imgur.com/0lHHN95.png" alt="GPUs too expensive" style="width: 10%; min-width: 100px; display: block; margin: left;">

- [My Ko-fi page](https://ko-fi.com/sicarius) ALL donations will go for research resources and compute, every bit is appreciated 🙏🏻

## Other stuff
- [Blog and updates](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog.
- [SLOP_Detector](https://github.com/SicariusSicariiStuff/SLOP_Detector) Nuke GPTisms, with SLOP detector.
- [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all.