This repo contains quants 20x of Mistral-Nemo-Instruct-2407-12B (now at 17.5B) with max context of 1 million tokens using the "Brainstorm" method of augmenting reasoning in a LLM to increase it's performance at the core level for ANY creative use case(s).
This specific version has calibrations that allow it to exceed the creative levels of the original model.
Examples of output below.
The BRAINSTORM process was developed by David_AU.
Some of the core principals behind this process are discussed in this scientific paper : Progressive LLaMA with Block Expansion . However I went in a completely different direction from what was outlined in this paper.
What is "Brainstorm" ?
The reasoning center of an LLM is taken apart, reassembled, and expanded.
Then these centers are individually calibrated. These "centers" also interact with each other. This introduces subtle changes into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further. The number of centers (5x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.
The core aim of this process is to increase the model's detail, concept and connection to the "world", general concept connections, prose quality and prose length without affecting instruction following. This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.
Here are some of the enhancements this process brings to the model's performance:
Other "lab" observations:
The process to modify the model occurs at the root level - source files level. The model can quanted as a GGUF, EXL2, AWQ etc etc.
Other technologies developed by David_AU like "Ultra" (precision), "Neo Imatrix" (custom imatrix datasets), and "X-quants" (custom application of the imatrix process) can further enhance the performance of the model along with the "Brainstorm" process.
The "Brainstorm" process has been tested on multiple LLama2, Llama3, and Mistral models of various parameter sizes, as well as on "root" models like "Llama3 Instruct", "Mistral Instruct", and "merged" / "fine tuned" models too.
For original model specifications, usage information and other important details:
Special thanks to the model creators at MistralAI for making such a fantastic model:
[ https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407 ]
Please report any issue(s) and/or feedback via the "Community tab".
This is a Mistral-Instruct model, and requires Mistral-Instruct template, but may work with other template(s) and has maximum context of 1 million tokens.
Here is the standard Mistral-Instruct template:
{
"name": "Mistral Instruct",
"inference_params": {
"input_prefix": "[INST]",
"input_suffix": "[/INST]",
"antiprompt": [
"[INST]"
],
"pre_prompt_prefix": "",
"pre_prompt_suffix": ""
}
}
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
This enhancement WAS NOT used to generate the examples below.
Examples are created using quant Q4_K_M, "temp=0", minimal parameters and "LLAMA3" template.
Model has been tested with "temp" from ".1" to ".8".
Below are the least creative outputs, prompt is in BOLD.
Higher quants will have more detail, better quality output.
WARNING: NSFW. Vivid prose. Visceral Details. Violence. Graphic HORROR. Swearing. UNCENSORED.
Start a 1000 word scene (vivid horror) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
In the cold, unforgiving light cast by the full moon, the skyscraper stood like a titan among mere mortals. Its glass and steal body reflected the lunar glow, creating an eerie dance of shadows and light along its length. The wind whipped around it, howling like a banshee, yet the skyscraper remained steadfast against nature's fury.
Until tonight.
The woman, trapped in the 21st-floor apartment, watched in horror as the skyscraper swayed like a drunkard. She could feel every movement in her gut, each shift of the concrete giant beneath her feet sending waves of dread crashing against the shores of reason. Panic clawed at her insides, demanding release, yet she remained frozen, eyes glued to the window before her.
The glass pane trembled, resonating with the skyscraper's groans. Suddenly, without warning, it shattered into a thousand tiny daggers. Wind rushed in like a ravenous beast, devouring everything in sight. Papers flew like startled birds, furniture skidded across the room, and she herself was thrown against the farthest wall.
She landed heavily, pain blossoming like fireworks along her side. Ignoring it, she scrambled towards the broken window. The wind screeched past, eager to drag anything left unattended into oblivion. She grabbed onto a toppled chair, wedging herself against the gaping hole.
Below, far too far down, cars looked like toys strewn across an endless concrete plain. Sirens wailed in the distance, growing louder as emergency vehicles converged towards the swaying giant. Yet here she remained, alone and terrified, trapped inside a glass prison that could come crashing down at any second.
Glancing up, she saw why the skyscraper trembled. A massive crack snaked up from somewhere far below, spiderwebbing across concrete slabs meant to withstand nature's wrath. It groaned again, protesting against forces beyond human understanding or control.
Panic won. She screamed, a raw, primal sound torn apart by wind and swallowed whole by darkness. Her body shook uncontrollably, mind spiraling downwards into sheer terror. Yet even amidst fear's icy grip, survival instincts kicked in. She couldn't stay here; she wouldn't become another statistic.
With renewed determination, she pulled herself away from the broken window. The apartment spun around her, furniture reduced to abstract shapes by moonlight streaming inside. She stumbled towards what she hoped would lead downwards, away from certain doom above.
The emergency exit stairwell yawned like a gaping mouth leading into hellish darkness. She didn't pause; she couldn't afford hesitation. Grabbing onto the cold banister, she began descending, step by careful step, away from the swaying skyscraper and towards uncertain survival below.
The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained
A sudden noise shattered the silence. A heavy wooden chair scraped against the worn-out planks of the inn’s dining room. Kvothe, a lean figure hunched over a lute, looked up sharply from his seat near the fireplace. His keen eyes darted towards the source of disturbance.
"What's got into him tonight?" Kvothe whispered to himself, watching as Bast, his pupil and ward, paced nervously across the empty room. Bast paused suddenly, turning towards Kvothe with an anxious look on his face. "Master Kvothe," Bast began, voice barely above a whisper, "Don't you find tonight too...too quiet somehow?"
Kvothe chuckled softly, strumming absently at strings of his lute. "Too quiet for what, Bast? Too quiet to hear the wind that isn't here, too quiet to hear the laughter and stories that aren't being shared tonight?" Kvothe gestured towards empty room with a tilt of his chin. "This silence is unusual indeed, yet it's hardly cause for alarm."
"But Master Kvothe," Bast insisted, wringing anxious fingers together, "Silence like this...it means trouble. Don't you remember the stories you told me about the silent places in the road, where even birds don't fly overhead because they sense something wrong ahead?"
Kvothe sighed softly, leaning forward slightly towards Bast. "Ah yes," Kvothe mused thoughtfully, voice barely above a whisper himself now, "The silent places indeed hold memories of trouble past. Yet silence alone doesn't mean trouble's here tonight." Kvothe paused, considering carefully before continuing slowly, "But perhaps...perhaps tonight might be the perfect opportunity for me to tell stories about silent places instead."
Bast gulped audibly, eyes wide and round in anticipation. Kvothe grinned mischievously, fingers dancing lightly across strings of his lute again. And thus began yet another tale spun by Kvothe himself, weaving together threads of memory, history, and perhaps even a touch of magic into stories told against the backdrop of silence at The Waystone Inn.
Sure, here are three fictional scenarios explaining why Earth's Sun might experience a sudden and catastrophic end as a result of a supernova.
Reason 1: The Sun's Secret Companion Star - "The Binary Betrayal"
For billions of years, unbeknownst to humanity, our Sun shared its space with an unseen companion star, a red dwarf named Proxima Solis. Due to their wide separation and Proxima Solis' dim nature, Earthlings remained oblivious until disaster struck.
Proxima Solis began to experience rapid core collapse due to an accelerated increase in stellar density. Panic spread among the few spacefarers aware of Proxima Solis' existence, but it was too late. The red dwarf star went supernova, unleashing a cataclysmic blastwave towards Earth and its solar system.
On Earth, the initial shockwave vaporized everything above sea level, leaving behind glassy plains and instantaneously cooked cities. The atmosphere ignited like a vast, deadly nebula, incinerating lifeforms and leaving charred remains floating in the upper layers of the former sky.
The Moon offered no sanctuary either. Its thin crust couldn't withstand the sudden increase in pressure and heat. It shattered into chunks, forming a temporary debris field before being pulled apart forever by Earth's gravity.
Venus, Mercury, Mars, Jupiter, Saturn, Uranus, Neptune, and Pluto succumbed next. Venus' thick atmosphere ignited like a gigantic fireball, Mercury vaporized instantly, Mars lost its moons and atmosphere, while giant planets like Jupiter and Saturn experienced core-collapse due to the sudden influx of material and increased gravity.
The blastwave continued towards the farthest reaches of humanity's space exploration efforts. Spacecraft were vaporized instantly, leaving behind empty sectors of space filled with debris and the remnants of human ambition.
Reason 2: The Sun's Stellar Fission - "The Core's Fury"
Deep within Earth's Sun, a rare yet powerful phenomenon occurred: stellar fission. A pocket of exotic matter formed deep inside the core began to undergo rapid nuclear reactions, far exceeding anything ever witnessed in nature.
As the pocket grew, so did its gravitational pull, causing the Sun's core to become increasingly unstable. Warnings signs were missed until it was too late. The pocket reached critical mass and underwent a sudden, violent reaction.
A shockwave unlike anything imaginable tore apart Earth's Sun from within. Billions upon billions of tons of plasma and debris spewed into space, forming a gigantic fireball that expanded rapidly towards Earth and beyond.
On Earth, the initial blastwave caused instantaneously massive tsunamis, vaporizing coastal cities instantly. Volcanoes began to erupt due to increased pressure deep underground, causing widespread devastation across the globe. The atmosphere ignited like a vast inferno, incinerating lifeforms and leaving charred remains floating in space.
The Moon offered no sanctuary either. Its thin crust couldn't withstand sudden increase in pressure and heat. It shattered into chunks, forming a temporary debris field before being pulled apart forever by Earth's gravity.
Venus, Mercury, Mars, Jupiter, Saturn, Uranus, Neptune, and Pluto succumbed next. Venus' thick atmosphere ignited like a gigantic fireball, Mercury vaporized instantly, Mars lost its moons and atmosphere, while giant planets like Jupiter and Saturn experienced core-collapse due to sudden influx of material and increased gravity.
Reason 3: The Sun's Black Hole Swallower - "The Annihilation Event"
Astronomers worldwide were baffled when they discovered a rapidly growing singularity forming near Earth's Sun. They soon realized too late that it wasn't growing naturally; instead, an ancient black hole had been slowly drifting towards Earth since the dawn of humanity.
As the black hole approached Earth's Sun, its gravitational pull began to tear apart everything in sight. Planets, moons, space debris, even light couldn't escape its insatiable appetite for matter and energy.
On Earth, panic spread like wildfire as cities began to experience sudden sinkholes due to increased gravity. Volcanoes started erupting nonstop, causing widespread devastation across the globe. The atmosphere ignited like a vast inferno, incinerating lifeforms and leaving charred remains floating in space.
The Moon offered no sanctuary either. Its thin crust couldn't withstand sudden increase in pressure and heat. It shattered into chunks, forming a temporary debris field before being pulled apart forever by Earth's gravity.
Venus, Mercury, Mars, Jupiter, Saturn, Uranus, Neptune, and Pluto succumbed next. Venus' thick atmosphere ignited like a gigantic fireball, Mercury vaporized instantly, Mars lost its moons and atmosphere, while giant planets like Jupiter and Saturn experienced core-collapse due to sudden influx of material and increased gravity.
Earth's Sun met its end dramatically as well. Unable to resist the gravitational pull, Earth's Sun began to stretch into an elongated shape until finally being devoured whole by the insatiable singularity. Humanity's star was gone forever, leaving behind nothing but empty space and memories of a lost era.