--- license: apache-2.0 base_model: mistralai/Mistral-Nemo-Base-2407 tags: - generated_from_trainer - axolotl - mergekit - stackmerge datasets: - cognitivecomputations/Dolphin-2.9 - teknium/OpenHermes-2.5 - m-a-p/CodeFeedback-Filtered-Instruction - cognitivecomputations/dolphin-coder - cognitivecomputations/samantha-data - microsoft/orca-math-word-problems-200k - Locutusque/function-calling-chatml - internlm/Agent-FLAN - BeaverAI/Nemo-Inst-Tune-ds library_name: transformers language: - en - fr - de - es - it - pt - ru - zh - ja --- # Ix Chel L3 12B This model is a merge of three self-stacked mistral-nemo-based models in a 17.7b (60 layer) configuration. This was intended to be merely a test of the viability of various stacking techniques for nemo, but this variation somehow turned out good enough to publish. Sort of. Mergefuel: - v000000/L3-8B-Poppy-Sunspice - mlabonne/NeuralDaredevil-8B-abliterated See recipe.yml for full details. As all components are L3-based, coherency out to 32k context appears to be good. This model is uncensored and perfectly capable of generating objectionable material. It does not seem to have a propensity to insert NSFW content into SFW prompts, but YMMV. As with any LLM, no factual claims made by the model should be taken at face value. You know that boilerplate safety disclaimer that most professional models have? Assume this has it too. This model is for entertainment purposes only. iMatrix GGUFs: https://huggingface.co/MarsupialAI/IxChel-L3-12B_iMatrix_GGUF EXL2: https://huggingface.co/MarsupialAI/IxChel-L3-12B_EXL2 If you create additional quants, please let me know and I will link them here as well. # Sample output ``` {{[INPUT]}} Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert. {{[OUTPUT]}} ``` # Prompt Format LOL. Components use three different instruct formats, so it will chew on anything to some extent. # What is the Lusca? The Lusca is a fearsome sea monster from Caribbean folklore. Envisioned as a monstrous hybrid of shark and octopus, or sometimes as a gargantuan squid, this creature is said to lurk in the depths of the ocean. Its immense size, often described as exceeding 75 feet, combined with its powerful tentacles and razor-sharp teeth, has made it a legendary figure of terror. The Lusca is blamed for disappearances of swimmers, divers, and even entire boats, its attacks often preceded by a disturbance of the water and a trail of bubbles. A symbol of the unknown dangers of the deep, the Lusca has captured the imagination of seafarers and landlubbers alike, ensuring its place as one of the most infamous cryptids of the Caribbean.