TeeZee commited on
Commit
60d2f6b
1 Parent(s): 4872a18

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -38
README.md CHANGED
@@ -1,38 +1,51 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # V3_u_5_scaling
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the breadcrumbs_ties merge method using F:\merger\mergekit\V3_ultraperecision\V3_u_4_scaling as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * F:\text_models\Iambe-RP-v3-20b
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
-
27
- ```yaml
28
- models:
29
- - model: "F:\\merger\\mergekit\\V3_ultraperecision\\V3_u_4_scaling"
30
- - model: "F:\\text_models\\Iambe-RP-v3-20b"
31
- parameters:
32
- weight: 0.5
33
- density: 0.9
34
- gamma: 0.01
35
- base_model: "F:\\merger\\mergekit\\V3_ultraperecision\\V3_u_4_scaling"
36
- merge_method: breadcrumbs_ties
37
- dtype: float32
38
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - merge
5
+ - not-for-all-audiences
6
+ license_name: microsoft-research-license
7
+ ---
8
+ # DarkForest 20B v3.0
9
+
10
+ ![image/png](https://huggingface.co/TeeZee/DarkForest-20B-v3.0/resolve/main/DarkForest-20B-v3.0.jpg)
11
+
12
+
13
+ ## Model Details
14
+
15
+ - To create this model five step procedure was used.
16
+ - The resulting model has approximately 20 billion parameters.
17
+ - details of merge step in files:
18
+ - [darkforest_v3_step1.yml ](https://huggingface.co/TeeZee/DarkForest-20B-v3.0/blob/main/darkforest_v3_step1.yml)
19
+ - [darkforest_v3_step2.yml ](https://huggingface.co/TeeZee/DarkForest-20B-v3.0/blob/main/darkforest_v3_step2.yml)
20
+ - [darkforest_v3_step3.yml ](https://huggingface.co/TeeZee/DarkForest-20B-v3.0/blob/main/darkforest_v3_step3.yml)
21
+ - [darkforest_v3_step4.yml ](https://huggingface.co/TeeZee/DarkForest-20B-v3.0/blob/main/darkforest_v3_step4.yml)
22
+ - [darkforest_v3_step5.yml ](https://huggingface.co/TeeZee/DarkForest-20B-v3.0/blob/main/darkforest_v3_step5.yml)
23
+
24
+ ## Models used
25
+ - custom model, based on athirdpath/Orca-2-13b-Alpaca-Uncensored and KoboldAI/LLaMA2-13B-Erebus-v3
26
+ - BigMaid-20B-v2.0
27
+ - athirdpath/Harmonia-20B
28
+ - athirdpath/Iambe-RP-v3-20b
29
+
30
+ ## Models removed
31
+ -- jebcarter_psyonic-cetacean-20B
32
+
33
+ ## Merge method
34
+ - all merges done in float32 precision, when applicable, breadcrumbs_ties merge method was used.
35
+
36
+ **Warning: This model can produce NSFW content!**
37
+
38
+ ## Results
39
+
40
+ - main difference to v2.x - model follows much better character cards and also user profile.
41
+ - produces SFW nad NSFW content without issues, switches context seamlessly.
42
+ - good at following instructions.
43
+ - good at tracking multiple characters in one scene.
44
+ - very creative, scenarios produced are mature and complicated, model doesn't shy from writing about PTSD, mental issues or complicated relationships.
45
+ - NSFW output is more creative and suprising than typical limaRP output.
46
+ - definitely for mature audiences, not only because of vivid NSFW content but also because of overall maturity of stories it produces.
47
+ - This is NOT Harry Potter level storytelling.
48
+
49
+ All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
50
+ <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
51
+