sandwichdoge
commited on
Commit
•
83b7ccb
1
Parent(s):
31d20a9
Update README.md
Browse files
README.md
CHANGED
@@ -2,4 +2,18 @@ Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
|
|
2 |
|
3 |
Using cleaned pippa.parquet as calibration dataset.
|
4 |
|
5 |
-
5bpw - Can run 10k context in ~23.3GB VRAM with 8bit-cache option.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
|
3 |
Using cleaned pippa.parquet as calibration dataset.
|
4 |
|
5 |
+
5bpw - Can run 10k context in ~23.3GB VRAM with 8bit-cache option.
|
6 |
+
|
7 |
+
Prompt format - extended alpaca with length modifier:
|
8 |
+
```
|
9 |
+
Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
|
10 |
+
|
11 |
+
### Instruction:
|
12 |
+
{instruction}
|
13 |
+
|
14 |
+
### Input:
|
15 |
+
{input}
|
16 |
+
|
17 |
+
### Response (length = long):
|
18 |
+
|
19 |
+
```
|