Dark Forests
Collection
Models for mature, intriguing storytelling and RP/ERP.
•
9 items
•
Updated
•
1
DarkSapling-7B-v1.1
Model Details
- A result of 4 models merge.
- models used for merge: cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser KoboldAI/Mistral-7B-Holodeck-1 KoboldAI/Mistral-7B-Erebus-v3 cognitivecomputations/samantha-mistral-7b
- See mergekit-config.yml for details on the merge method used.
Warning: This model can produce NSFW content!
Results
- a little different than version v1.0, more romantic and empathetic.
- best for one-on-one ERP.
- produces SFW nad NSFW content without issues, switches context seamlessly.
- sticks to character card
- pretty smart due to mistral, empathetic after Samantha and sometimes produces dark scenarions - Erebus.
- storytelling is satisfactory due to Holodeck
- good at following instructions
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 64.80 |
| AI2 Reasoning Challenge (25-Shot) | 63.48 |
| HellaSwag (10-Shot) | 85.09 |
| MMLU (5-Shot) | 64.47 |
| TruthfulQA (0-shot) | 52.04 |
| Winogrande (5-shot) | 78.53 |
| GSM8k (5-shot) | 45.19 |
- Downloads last month
- 64
Inference API (serverless) is not available, repository is disabled.
Collection including TeeZee/DarkSapling-7B-v1.1
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard63.480
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard85.090
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard64.470
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard52.040
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard78.530
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard45.190