File size: 2,726 Bytes
d355b35 fc92930 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 |
---
license: apache-2.0
base_model: mistralai/Mistral-Nemo-Base-2407
tags:
- generated_from_trainer
- axolotl
- mergekit
- stackmerge
datasets:
- cognitivecomputations/Dolphin-2.9
- teknium/OpenHermes-2.5
- m-a-p/CodeFeedback-Filtered-Instruction
- cognitivecomputations/dolphin-coder
- cognitivecomputations/samantha-data
- microsoft/orca-math-word-problems-200k
- Locutusque/function-calling-chatml
- internlm/Agent-FLAN
- BeaverAI/Nemo-Inst-Tune-ds
library_name: transformers
language:
- en
- fr
- de
- es
- it
- pt
- ru
- zh
- ja
---
# Ix Chel L3 12B
This model is a merge of three self-stacked mistral-nemo-based models in a 17.7b (60 layer) configuration. This was intended
to be merely a test of the viability of various stacking techniques for nemo, but this variation somehow turned out good enough
to publish. Sort of.
Mergefuel:
- v000000/L3-8B-Poppy-Sunspice
- mlabonne/NeuralDaredevil-8B-abliterated
See recipe.yml for full details. As all components are L3-based, coherency out to 32k context appears to be good.
This model is uncensored and perfectly capable of generating objectionable material. It does not seem to have a
propensity to insert NSFW content into SFW prompts, but YMMV. As with any LLM, no factual claims
made by the model should be taken at face value. You know that boilerplate safety disclaimer that most professional models have?
Assume this has it too. This model is for entertainment purposes only.
iMatrix GGUFs: https://huggingface.co/MarsupialAI/IxChel-L3-12B_iMatrix_GGUF
EXL2: https://huggingface.co/MarsupialAI/IxChel-L3-12B_EXL2
If you create additional quants, please let me know and I will link them here as well.
# Sample output
```
{{[INPUT]}}
Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
{{[OUTPUT]}}
```
# Prompt Format
LOL. Components use three different instruct formats, so it will chew on anything to some extent.
# What is the Lusca?
The Lusca is a fearsome sea monster from Caribbean folklore. Envisioned as a monstrous hybrid of shark and octopus, or sometimes as a gargantuan squid,
this creature is said to lurk in the depths of the ocean. Its immense size, often described as exceeding 75 feet, combined with its powerful tentacles
and razor-sharp teeth, has made it a legendary figure of terror. The Lusca is blamed for disappearances of swimmers, divers, and even entire boats, its
attacks often preceded by a disturbance of the water and a trail of bubbles. A symbol of the unknown dangers of the deep, the Lusca has captured the
imagination of seafarers and landlubbers alike, ensuring its place as one of the most infamous cryptids of the Caribbean. |