Commit
•
c0705c4
1
Parent(s):
2f9c2ad
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: microsoft-research-license
|
| 4 |
+
tags:
|
| 5 |
+
- merge
|
| 6 |
+
- not-for-all-audiences
|
| 7 |
+
---
|
| 8 |
+
# DarkForest 20B v2.0 iMat GGUF
|
| 9 |
+
<h4><i>"The universe is a dark forest. Every civilization is an armed hunter stalking through the trees like a ghost, gently pushing aside branches that block the path and trying to tread without sound. Even breathing is done with care. The hunter has to be careful, because everywhere in the forest are stealthy hunters like him."- Liu Cixin</i></h4>
|
| 10 |
+
|
| 11 |
+
|
| 12 |
+
Continuation of an ongoing initiative to bring the latest and greatest models to consumer hardware through SOTA techniques that reduce VRAM overhead.
|
| 13 |
+
|
| 14 |
+
After testing the new important matrix quants for 11b and 8x7b models and being able to run them on machines without a dedicated GPU, we are now exploring the middleground - 20b.
|
| 15 |
+
|
| 16 |
+
<b>❗❗Need a different quantization/model? Please open a community post and I'll get back to you - thanks ❗❗ </b>
|
| 17 |
+
|
| 18 |
+
(Credits to [TeeZee](https://huggingface.co/TeeZee/) for the original model and [ikawrakow](https://github.com/ikawrakow) for the stellar work on IQ quants)
|
| 19 |
+
|
| 20 |
+
---
|
| 21 |
+
|
| 22 |
+
# DarkForest 20B v2.0
|
| 23 |
+
|
| 24 |
+
|
| 25 |
+
|
| 26 |
+
|
| 27 |
+
## Model Details
|
| 28 |
+
|
| 29 |
+
- To create this model two step procedure was used. First a new 20B model was created using [microsoft/Orca-2-13b](https://huggingface.co/microsoft/Orca-2-13b)
|
| 30 |
+
and [KoboldAI/LLaMA2-13B-Erebus-v3](https://huggingface.co/KoboldAI/LLaMA2-13B-Erebus-v3) , deatils of the merge in [darkforest_v2_step1.yml](https://huggingface.co/TeeZee/DarkForest-20B-v2.0/resolve/main/darkforest_v2_step1.yml)
|
| 31 |
+
- then [jebcarter/psyonic-cetacean-20B](https://huggingface.co/jebcarter/psyonic-cetacean-20B)
|
| 32 |
+
- and [TeeZee/BigMaid-20B-v1.0](https://huggingface.co/TeeZee/BigMaid-20B-v1.0) was used to produce the final model, merge config in [darkforest_v2_step2.yml](https://huggingface.co/TeeZee/DarkForest-20B-v2.0/resolve/main/darkforest_v2_step2.yml)
|
| 33 |
+
- The resulting model has approximately 20 billion parameters.
|
| 34 |
+
|
| 35 |
+
|
| 36 |
+
**Warning: This model can produce NSFW content!**
|
| 37 |
+
|
| 38 |
+
## Results
|
| 39 |
+
|
| 40 |
+
- main difference to v1.0 - model has much better sense of humor.
|
| 41 |
+
- produces SFW nad NSFW content without issues, switches context seamlessly.
|
| 42 |
+
- good at following instructions.
|
| 43 |
+
- good at tracking multiple characters in one scene.
|
| 44 |
+
- very creative, scenarios produced are mature and complicated, model doesn't shy from writing about PTSD, menatal issues or complicated relationships.
|
| 45 |
+
- NSFW output is more creative and suprising than typical limaRP output.
|
| 46 |
+
- definitely for mature audiences, not only because of vivid NSFW content but also because of overall maturity of stories it produces.
|
| 47 |
+
- This is NOT Harry Potter level storytelling.
|
| 48 |
+
|
| 49 |
+
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
|
| 50 |
+
<a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
|