Fischerboot
commited on
Commit
•
e38e7fb
1
Parent(s):
3217db2
Update README.md
Browse files
README.md
CHANGED
@@ -13,14 +13,19 @@ This is a merge and a finetune to create a small, but very useable Model, and i
|
|
13 |
|
14 |
## Basic Question:
|
15 |
|
16 |
-
|
17 |
|
18 |
|
19 |
## Prompt Template
|
20 |
|
21 |
Tinyllama-2B uses Alpaca:
|
22 |
|
|
|
|
|
|
|
23 |
|
|
|
|
|
24 |
|
25 |
### Merge Info
|
26 |
|
@@ -58,10 +63,11 @@ slices:
|
|
58 |
- sources:
|
59 |
- layer_range: [16, 22] # angepasst von [24, 32] auf [16, 22]
|
60 |
model: concedo/KobbleTinyV2-1.1B
|
61 |
-
|
62 |
|
63 |
## Finetune Info:
|
64 |
|
|
|
65 |
|
66 |
```yaml
|
67 |
base_model: Fischerboot/2b-tiny-llama-alpaca-instr
|
@@ -139,3 +145,4 @@ weight_decay: 0.0
|
|
139 |
fsdp:
|
140 |
fsdp_config:
|
141 |
special_tokens:
|
|
|
|
13 |
|
14 |
## Basic Question:
|
15 |
|
16 |
+
<img src="https://raw.githubusercontent.com/Fischherboot/Aculi/main/watermark-no-bg.png" alt="download.png" width="200" />
|
17 |
|
18 |
|
19 |
## Prompt Template
|
20 |
|
21 |
Tinyllama-2B uses Alpaca:
|
22 |
|
23 |
+
```yaml
|
24 |
+
### Instruction:
|
25 |
+
{prompt}
|
26 |
|
27 |
+
### Response:
|
28 |
+
```
|
29 |
|
30 |
### Merge Info
|
31 |
|
|
|
63 |
- sources:
|
64 |
- layer_range: [16, 22] # angepasst von [24, 32] auf [16, 22]
|
65 |
model: concedo/KobbleTinyV2-1.1B
|
66 |
+
```
|
67 |
|
68 |
## Finetune Info:
|
69 |
|
70 |
+
The following YAML configuration was used to finetune this model:
|
71 |
|
72 |
```yaml
|
73 |
base_model: Fischerboot/2b-tiny-llama-alpaca-instr
|
|
|
145 |
fsdp:
|
146 |
fsdp_config:
|
147 |
special_tokens:
|
148 |
+
```
|