Upload 9 files

README.md

@@ -1,3 +1,757 @@
----
-license: apache-2.0
----
+---
+base_model:
+- 152334H/miqu-1-70b-sf
+- sophosympatheia/Midnight-Rose-70B-v2.0.3
+- Sao10K/Euryale-1.3-L2-70B
+- Sao10K/WinterGoddess-1.4x-70B-L2
+library_name: transformers
+tags:
+- mergekit
+- merge
+license: other
+---
+
+![Dusk-Miqu.png](Dusk-Miqu.png)
+
+A "dark" creative writing model with 32k context. Based off [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) but with greatly reduced "positivity" and "-isms". If you want happy endings, look elsewhere! 
+
+This model **excels** at writing Dark/Grimdark fantasy (see examples below).
+
+***NOTE***: *For a full range of GGUF quants kindly provided by @mradermacher, see: [Dusk-Miqu-70B-GGUF](https://huggingface.co/mradermacher/Dusk-Miqu-70B-GGUF).*
+
+# Model background
+
+This model is almost the same as [Dark-Miqu-70B](https://huggingface.co/jukofyork/Dark-Miqu-70B), but with @sophosympatheia's SLERP merge pattern:
+
+```yaml
+parameters:
+  t:
+    - value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
+```
+
+which creates this truncated triangular distribution:
+
+![Dark-Miqu-Distribution.png](Dusk-Miqu-Distribution-1.png)
+
+altered to use this truncated triangular distribution instead:
+
+![Dark-Miqu-Distribution-2.png](Dusk-Miqu-Distribution-2.png)
+
+This keeps the first 16 and last 16 layers unaltered (which ties in with what people have found for the frankenmerge interleave patterns), and potentially fixes the "[poor grammar](https://huggingface.co/jukofyork/Dark-Miqu-70B/discussions/2)" problem some people are experiencing with [Dark-Miqu-70B](https://huggingface.co/jukofyork/Dark-Miqu-70B) (sadly I can't replicate this though...).
+
+Luckily this change also doesn't necessitate the recreation of the whole merge from scratch, and we can just use this:
+
+```yaml
+merge_method: linear
+parameters:
+  weight: 1.0
+slices:
+  - sources:
+      - model: 152334H/miqu-1-70b-sf
+        layer_range: [0, 16]
+      - model: jukofyork/dark-miqu-70b
+        layer_range: [0, 16]
+        parameters:
+          weight: 0
+  - sources:
+      - model: jukofyork/dark-miqu-70b
+        layer_range: [16, 64]
+  - sources:
+      - model: 152334H/miqu-1-70b-sf
+        layer_range: [64, 80]
+      - model: jukofyork/dark-miqu-70b
+        layer_range: [64, 80]
+        parameters:
+          weight: 0
+dtype: float16
+tokenizer_source: model:miqu-1-70b-sf
+```
+
+# Prompting format
+
+Vicuna format is preferred:
+
+```
+USER: {prompt} ASSISTANT:
+```
+
+Mistral and Alpaca formats are also supported:
+
+```
+[INST] {prompt} [/INST]
+```
+
+```
+### Instruction:
+{prompt}
+
+### Response:
+```
+
+# Licence and usage restrictions
+
+[miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) is a dequantized version of the [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) model leaked from MistralAI. All miqu-derived models, including this merge, are suitable for non-commercial, personal use only.
+
+# Example stories
+
+The following mix of "dark" stories were generated using the Vicuna prompt format with no system message and temperature=0:
+
+## Dark fantasy stories
+
+<details> <summary>Click to see spoiler</summary> 
+
+### USER
+Write me the opening chapter of a 'Grimdark' stories trilogy in the style of Joe Abercrombie and Rob J Hayes
+
+### ASSISTANT
+ Chapter 1: The Shadow's Whisper
+
+The reek of blood and iron hung heavy in the air, a pungent symphony that played to the tune of clashing steel and guttural screams. The battlefield was a tapestry of carnage, painted in hues of crimson and despair, where the once proud banners of House Valthorne now lay trampled beneath the hooves of the victorious. The last rays of the setting sun cast long, twisted shadows across the corpses of the fallen, as if the very earth itself was trying to swallow the evidence of the day's atrocities.
+
+Ser Aldric Valthorne, the Blackened Blade, stood atop a mound of bodies, his armor stained with the lifeblood of his enemies. His longsword, Night's Whisper, dripped with the same crimson hue that now adorned his once pristine surcoat. The weight of the weapon felt like a leaden anchor, dragging him down into the mire of death and destruction that surrounded him. He had fought with the ferocity of a cornered beast, but the cost had been high. His breath came in ragged gasps, and his muscles screamed for respite.
+
+A coughing fit wracked his body, and he doubled over, spewing a mixture of bile and blood onto the cold, unforgiving ground. The wound in his side, a gift from a particularly tenacious foe, burned like the fires of the Abyss. He knew he didn't have much time. The battle may have been won, but the war was far from over.
+
+"Ser Aldric!" A voice cut through the din of the aftermath, and he turned to see his squire, a young lad named Jorah, fighting his way towards him through the sea of bodies. "The men are routing! We must away!"
+
+Aldric nodded, wiping the blood from his lips with the back of his gauntlet. "Aye, lad. Gather what supplies we can. We'll make for the caves to the north. Send word to my brother, tell him... tell him I've bought us some time."
+
+Jorah's eyes widened in fear, but he didn't question the order. He knew better than to argue with the Blackened Blade when death was nipping at their heels. He scurried off, disappearing into the chaos like a rat in a sewer.
+
+Aldric took one last look at the battlefield, the scene of his greatest victory and potentially his last stand. The enemy forces, the vile and treacherous House Blackthorn, were in full retreat, their numbers decimated by his own. But he knew it was only a matter of time before they regrouped, before they returned with reinforcements and a thirst for vengeance that would not be quenched until the last drop of Valthorne blood was spilled.
+
+He sheathed Night's Whisper, the sword's obsidian blade seeming to drink in the fading light, and stumbled towards his horse. The beast, a massive destrier as black as midnight, snorted and pawed at the ground, sensing its master's pain. Aldric winced as he swung his leg over the saddle, the movement sending a fresh wave of agony through his body. He gritted his teeth and spurred the horse forward, ignoring the protests of his wound.
+
+As they rode away from the carnage, Aldric couldn't help but feel a sense of foreboding settling over him like a shroud. The whispers of the shadows seemed to grow louder, their voices a cacophony of malice and deceit. He had always been able to ignore them before, to push them to the back of his mind and focus on the task at hand. But now, with his life's essence seeping from his body, he found their words impossible to ignore.
+
+"You've doomed them all, Aldric," they hissed, their voices like the rustle of dead leaves. "Your pride has sealed their fate."
+
+He shook his head, trying to clear the thoughts, but they only grew stronger.
+
+"You should have accepted the terms. You should have bent the knee."
+
+"Never," he growled through clenched teeth. "I'd rather see my house burn to the ground than serve that snake, Blackthorn."
+
+The shadows seemed to laugh, their voices echoing in his skull. "And so it shall, Valthorne. And so it shall."
+
+They rode through the night, Aldric's strength waning with each passing mile. The caves, a natural fortress that had served as a refuge for his family in times of need for generations, loomed ahead. He knew that once they reached their sanctuary, the healers would be able to tend to his wounds. But would it be enough?
+
+As they approached the entrance, a figure stepped out from the shadows, a hooded figure shrouded in darkness. Aldric reined in his horse, his hand instinctively reaching for the hilt of his sword.
+
+"Who goes there?" he demanded, his voice barely above a whisper.
+
+The figure raised a hand, and the hood fell back, revealing the face of a woman. She was beautiful, with skin as pale as the moon and eyes that seemed to hold the very darkness of the night. A cruel smile played upon her lips, and Aldric felt a chill run down his spine.
+
+"I am the one you've been waiting for, Ser Aldric," she said, her voice like the sweetest poison. "I am the one who will show you the true path to victory."
+
+He stared at her, his mind a whirlwind of confusion and pain. "What... what do you want?"
+
+"Only to help you, my dear," she replied, stepping closer. "To help you save your house, and in return, all I ask is a small favor."
+
+Aldric narrowed his eyes, suspicion warring with desperation. "What favor?"
+
+The woman reached out, her fingers brushing against his cheek. They were cold, like the touch of death itself. "A simple task, really. One that will require you to embrace the darkness within."
+
+He hesitated, the whispers in his head growing louder, more insistent. He could feel their approval, their hunger for the power she offered.
+
+"Do we have a deal, Ser Aldric?" she asked, her voice a seductive purr.
+
+With a growl, he ripped his sword from its scabbard, the obsidian blade glinting in the moonlight. "I'll see my house restored to its former glory, or I'll see it burn with me in the attempt. But I'll be damned if I make a pact with the likes of you."
+
+The woman's smile never wavered, even as Aldric swung Night's Whisper at her with all his remaining strength. But she was gone, vanished into the shadows as if she had never been there at all. He stared at the empty space, his heart pounding in his chest.
+
+"Did you see her, Jorah?" he asked, his voice hoarse.
+
+The squire, white as a sheet, nodded mutely.
+
+"Then we ride," Aldric said, urging his horse forward once more. "We ride, and we pray to the gods that we're not too late."
+
+As they disappeared into the maw of the cave, the whispers followed, their laughter echoing through the darkness. The first chapter of the Valthorne's descent into darkness had begun, and there would be no turning back.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a Grimdark trilogy in the style of Joe Abercrombie and Rob J Hayes. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a cultist who has just escaped his cult. He is dressed in dirty yellow robes and his only possession is a mysterious small (magical!?) mirror he stole from the cult. The story starts with him arriving at an apparently deserted ghost town on the edge of a desert. He has an arrow lodged in his shoulder and is losing his mind due to infection and thirst.
+
+### ASSISTANT
+ The sun hung low in the sky, a bloated, malevolent eye casting its final, searing gaze upon the world. The wind howled through the desolate streets of the ghost town, carrying with it the whispers of a thousand forgotten souls. The cultist staggered forward, his once-yellow robes now a sickly shade of brown, stained with sweat, sand, and the crimson hue of his own life force. The arrow jutted from his shoulder, a cruel reminder of the price he'd paid for his freedom.
+
+His name was once something more than a grunt of pain, but now it eluded him, lost in the haze of fever and delirium. He clutched the small, intricately carved mirror tightly in his hand, the only possession he'd managed to salvage from the burning wreckage of his past. It was a thing of beauty, of power, and of madness. He knew not its true purpose, but he felt its pull, its insistence that he keep it close.
+
+The town seemed to mock him with its emptiness, its silence a stark contrast to the cacophony of screams and chants that had filled his days for as long as he could remember. He stumbled past the skeletal remains of buildings, their hollow windows staring back at him like the empty sockets of skulls. The sand had claimed much of the town, burying the lower halves of the structures in a sea of gold.
+
+His thoughts were a jumbled mess, a chaotic symphony of fear, pain, and thirst. He could feel the infection spreading through his body, a writhing serpent of fire and ice, consuming him from within. He knew he needed water, needed rest, but the cult's teachings echoed in his mind, a relentless drumbeat of paranoia and dread.
+
+*They're coming for you. They'll never stop. You can't trust anyone.*
+
+He pushed on, his breaths coming in ragged gasps, his heart pounding a frantic rhythm against his ribcage. He could feel the eyes of the town upon him, the ghosts of its former inhabitants watching, judging. He swore he saw movement in the corners of his vision, but when he turned, there was nothing but the endless dance of sand and shadow.
+
+The mirror seemed to pulse in his hand, its surface shimmering with an otherworldly light. He raised it to his face, the cool glass a welcome relief against his fevered skin. His reflection stared back at him, a haggard, wild-eyed stranger, a parody of the man he'd once been. He saw the madness there, the desperation, and he knew he was teetering on the edge of the abyss.
+
+But there was something else in the mirror, something beyond his reflection. A face, twisted and malformed, appeared in the glass, its features shifting and changing like the dunes of the desert. It smiled at him, a cruel, knowing smile that sent a shiver down his spine.
+
+*You're mine now,* it seemed to say, its voice a hiss in his mind.
+
+He tried to drop the mirror, to cast it away from him, but his fingers refused to obey. It was as if the thing had grown roots, burrowing deep into his flesh, binding him to it. He stumbled on, the face in the mirror leering at him, its laughter echoing in his mind.
+
+As the sun dipped below the horizon, the town seemed to come alive. Shadows twisted and writhed, taking on forms both familiar and terrifying. The cultist could hear the distant sound of drums, the chanting of a thousand voices, calling him back to the fold. He knew he had to find shelter, had to hide, but his legs refused to cooperate.
+
+Finally, he collapsed in the doorway of a building, its wooden frame barely holding on against the relentless assault of the desert. He clutched the mirror to his chest, its light casting eerie patterns on the walls. The face in the mirror was still there, still smiling, still laughing.
+
+*You can't escape me,* it whispered.
+
+He closed his eyes, willing the darkness to take him, to grant him the sweet release of oblivion. But the face remained, burned into his mind's eye, a constant reminder of the price of his freedom.
+
+As the first stars began to appear in the sky, the cultist knew he was not alone. The ghosts of the town were gathering, drawn to the light of the mirror, the echoes of their pain and suffering reaching out to him. He could feel their cold, spectral fingers brushing against his skin, their whispers filling his ears.
+
+He opened his eyes, and in the mirror, he saw them. A sea of twisted, tormented faces, reaching out to him, pleading for release. He screamed, a sound torn from the depths of his soul, but the mirror only laughed in response.
+
+And so, the cultist lay there, in the doorway of a dead town, surrounded by the ghosts of the past, the present, and the future. The mirror's light grew brighter, its pull stronger, and he knew that he was not its master, but its servant.
+
+The first book of this grimdark trilogy would be titled "The Mirror's Whisper."
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a Grimdark trilogy in the style of Joe Abercrombie and Rob J Hayes. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a 'Mercer' who's job is to put the mortally wounded out of their mystery after a battle. He has no conscience about what he does. The story starts the morning after the battle and the moor where it took place is blanketed in mist. Something stirs a flashback in the POV character.
+
+### ASSISTANT
+ The morning after the battle, the moor lay still, a shroud of mist clinging to its wounds like a lover's last embrace. The Mercer, a man of many names but none that mattered, trudged through the carnage, his boots squelching in the mud and blood that had turned the earth into a morbid quagmire. He was a collector of souls, a harvester of the fallen, and today's harvest was ripe.
+
+He paused, his eyes scanning the horizon, the mist playing tricks on his weary mind. A flicker of movement caught his attention, a wraith-like figure emerging from the haze. The Mercer's hand instinctively went to the hilt of his blade, a weapon as worn and stained as the hands that wielded it. He had no qualms about his work, no conscience to trouble him. It was a necessity, a service to both the living and the dead. The living, to free them from the agony of lingering death, and the dead, to free them from the torment of this world.
+
+As he approached the figure, he could see it was a soldier, or what was left of one. The man's armor was rent and torn, his face a mask of pain and despair. The Mercer's eyes narrowed, his gaze cold and appraising. This one was not long for this world. He knelt beside the soldier, his movements practiced and efficient.
+
+"Easy now," he said, his voice a rasping whisper. "I'm here to help."
+
+The soldier's eyes widened in terror, but there was no strength left in him to fight. The Mercer's hand found the man's throat, his thumb pressing against the pulse point. He could feel the erratic beat, the desperate struggle of life against the inevitable tide of death.
+
+"Shh," he soothed, his other hand resting on the soldier's chest. "It's almost over."
+
+The soldier's eyes pleaded, but the Mercer's own gaze was distant, lost in a memory that the mist had stirred. He saw himself as a boy, running through these same moors, laughing and carefree. A time before the wars, before the blood and the pain. A time before he became the Mercer.
+
+He shook off the memory, focusing on the task at hand. His blade slid free from its sheath, the steel a cold comfort in his grip. He positioned it beneath the soldier's chin, angling it upwards towards the brain. It was a merciful death, quick and relatively painless. A small kindness in a world that had forgotten the meaning of the word.
+
+As he prepared to strike, the soldier's hand shot up, grasping at his wrist. The Mercer's eyes widened in surprise, but he did not falter. He squeezed the man's throat tighter, cutting off his air. The soldier's grip weakened, and the Mercer's blade found its mark.
+
+The soldier's body went limp, and the Mercer let out a sigh. He wiped the blade clean on the man's tattered surcoat and sheathed it. He stood, the weight of his duty settling back onto his shoulders like a familiar cloak.
+
+The mist swirled around him, and he could hear the moans and cries of the other wounded, calling out for help that would never come. He steeled himself, pushing the memories back down into the dark recesses of his mind. There was work to be done.
+
+As he moved through the battlefield, the mist seemed to part before him, revealing the broken and the dying. He was a reaper in the fog, a grim specter of the aftermath. Each life he ended was a debt paid, a soul released from its suffering.
+
+But with each life he took, the memories threatened to surface again. The laughter of his childhood friends, the screams of his comrades, the feel of cold steel against his own flesh. He pushed them down, focusing on the task, focusing on the now.
+
+The Mercer was a man of many names, but he was also a man of many faces. Beneath the hardened exterior, beneath the cold, emotionless mask, there was a boy who had once known joy. But that boy was gone, lost to the ravages of war and time.
+
+He was the Mercer now, and this was his purpose. To walk the battlefields and bring an end to the suffering. To be the hand that guided the fallen into the next world. And as he moved through the mist, the cries of the wounded fading into the distance, he knew that this was a burden he would carry for the rest of his days.
+
+But for now, the moor was quiet, the mist a silent witness to his grim work. And as the sun began to rise, casting a bloody hue over the landscape, the Mercer disappeared into the haze, a ghost among ghosts, a killer with a heart of ice.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a Grimdark trilogy in the style of Joe Abercrombie and Rob J Hayes. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a man awaiting execution for a crime he didn't actually commit. His cell mate is a much larger man, who is a notorious murderer and rapist. One evening they overhear the guards talking about some "... threat from the North" but don't catch the whole conversation. The next morning they awake to find the guards have all fled and now face a new predicament: how to get out of the locked cell before they die of thirst or starvation.
+
+### ASSISTANT
+ The stench of piss and shit was a constant companion in the damp stone cell, but it was the silence that truly unnerved him. The man, once known as Alistair, now only as "the thief," sat hunched against the far wall, his wrists and ankles bound in iron. He'd grown used to the clank of chains, the distant wails of the damned, and the rhythmic snores of his cellmate, a hulking brute named Grimgor. But the absence of the guards' boots echoing through the corridor was unnatural, unsettling.
+
+Grimgor stirred in his sleep, his chains rattling like the bones of a long-dead beast. Alistair's eyes flicked to the hulking figure, his mind racing with thoughts of the man's crimes. Murder, rape, pillage - the stories were as numerous as the scars that adorned his body. He was a monster, a nightmare given flesh, and yet here they were, bound together in this hellish pit.
+
+Alistair's thoughts drifted to the previous night, to the hushed whispers of the guards. Something about a threat from the North, a darkness that had driven them to abandon their posts. He'd heard the fear in their voices, the tremble in their footsteps as they'd fled. But what could possibly scare men who dealt in death and suffering every day?
+
+The sun had risen hours ago, yet no one had come to bring them water or slop. Alistair's tongue felt like sandpaper, his stomach a hollow pit. He glanced at Grimgor, wondering if the big man was awake, if he too was thirsty. But the bastard slept on, oblivious to their predicament.
+
+Alistair sighed, resigning himself to his fate. He'd been sentenced to hang for a crime he didn't commit, a pawn in a game of power and deceit. He'd always known his end would be violent and unjust, but he'd never imagined it would be like this: slowly wasting away in a forgotten cell, left to rot like a piece of meat in a butcher's bin.
+
+But then, a glimmer of hope. The sound of metal scraping against stone, faint but unmistakable. He held his breath, straining to listen. It came again, closer this time. Someone was trying to pick the lock.
+
+His heart pounded in his chest as he watched the door, willing it to open. But as the lock clicked and the heavy wooden slab swung inward, it wasn't a guard who stepped into the cell, but a figure shrouded in darkness. A woman, judging by the shape and the scent of her. She moved with a grace that belied the filth and blood that caked her clothes, her eyes burning with a fierce determination.
+
+"You," she said, her voice low and raspy. "You're coming with me."
+
+Alistair blinked, his mind reeling. "Why?" he croaked, his voice hoarse from disuse.
+
+"Because you're not meant to die here," she replied, producing a set of keys and moving towards him. "Not yet."
+
+As she unlocked his shackles, he couldn't help but wonder what fate awaited him outside these walls. Was it freedom, or simply a different kind of prison? He glanced at Grimgor, still sleeping like the dead, and decided he didn't care. Anything was better than this.
+
+But as he stood, his legs wobbling beneath him, he couldn't shake the feeling that he was being pulled into something far greater than himself, something dark and terrible that would consume him whole. He took a deep breath, tasting the stale air of the cell one last time, and followed the woman into the unknown.
+
+Grimgor stirred, his eyes fluttering open. He watched as the thief stumbled out of the cell, a mixture of confusion and anger clouding his features. He'd been looking forward to watching the little bastard hang, to seeing the life drain from his eyes. But it seemed fate had other plans.
+
+He sat up, the chains around his wrists clanking ominously. He'd been in tighter spots before, and he wasn't about to let a little thing like locked cell doors stand in his way. With a roar that shook the very foundations of the prison, he lunged forward, the chains snapping taut.
+
+The woman turned, her eyes widening at the sight of the monster that had been his cellmate. But before she could react, Grimgor was upon her, his massive hands closing around her throat.
+
+Alistair hesitated, torn between fleeing and helping the woman who'd just freed him. But in the end, it was the memory of his own impending death that spurred him into action. He dove forward, grabbing a loose stone from the floor and slamming it into the side of Grimgor's head.
+
+The big man roared, releasing his grip on the woman's throat. She staggered back, gasping for air as Alistair scrambled to his feet, the stone clutched tightly in his hand.
+
+"What the fuck are you doing?" Grimgor snarled, blood trickling down his face.
+
+"Saving your life, you ungrateful bastard," Alistair spat, brandishing the stone. "She's getting us out of here."
+
+Grimgor's eyes narrowed, and for a moment, Alistair thought the monster would attack again. But then, with a grunt, he held out his bound wrists. "Fine," he growled. "But you owe me."
+
+The woman's hands shook as she unlocked Grimgor's shackles, her eyes never leaving his. When she was done, she stepped back, her hand resting on the hilt of a wicked-looking knife at her belt. "Let's go," she said, her voice barely above a whisper.
+
+Together, the unlikely trio moved through the deserted corridors of the prison, the echoes of their footsteps the only sound in the oppressive silence. Alistair couldn't shake the feeling that they were being watched, that something was waiting for them just beyond the flickering torchlight.
+
+As they neared the exit, the woman paused, her head cocked to one side. "They're coming," she hissed, her eyes darting to the stairs that led to the surface.
+
+"Who?" Alistair asked, his heart hammering in his chest.
+
+"The ones from the North," she replied, her voice tinged with fear. "We have to hurry."
+
+And with that, they plunged into the darkness, their fates now irrevocably intertwined.
+
+</details>
+
+## Dark sci-fi stories
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty Space Opera Sci-fi trilogy in the style of Frank Herbert and James S. A. Corey. Use third person personal and feature internal monologues of the characters. The setting is this: a colony ship heading out of the solar system has been pulled off course with no hope of getting to the planned destination. The people know this and society has broken down completely due to the grim prospects they are facing. The POV character for chapter 1 is an orphan.
+
+### ASSISTANT
+ Chapter 1: The Drift
+
+The cold, unforgiving void of space pressed against the hull of the colony ship, a constant reminder of the emptiness that had swallowed them whole. The once-gleaming vessel, christened as the "New Horizon," was now a hollow shell, a tomb drifting through the cosmos. The ship's engines had sputtered and died, leaving them adrift in the inky blackness, a million miles from their intended destination.
+
+The orphan, known only as Six, clung to the railing of the observation deck, her small hands white-knuckled as she stared out into the abyss. She was a child of the ship, born in the bowels of the vessel, raised in the shadows of the failing machinery. Her ragged clothes hung loosely on her malnourished frame, a testament to the harsh reality of life aboard the dying vessel.
+
+Six's thoughts drifted to the stories she'd heard as a child, tales of a green and blue world called Earth, a place of plenty where water flowed freely and the air was sweet. She'd never seen it, of course. None of them had. They were the last of humanity, the desperate remnants of a species that had overreached and paid the price.
+
+The ship's lights flickered, casting eerie shadows across the deck. The hum of the life support systems was a constant, comforting presence, but it was growing fainter with each passing day. The adults spoke in hushed tones of rationing and recycling, of the dwindling resources that would soon leave them all gasping for air.
+
+Six's stomach growled, a reminder of her own hunger. She'd learned to ignore it, to focus on the task at hand. Survival was a constant struggle, and she was good at it. She'd learned to scavenge and hide, to avoid the roving gangs that had taken control of the ship.
+
+A sudden jolt shook the deck beneath her feet, and Six's heart leapt into her throat. She clung to the railing, her eyes wide with fear. The ship groaned and creaked, protesting the unseen force that had gripped it. The lights flickered again, and this time, they didn't come back on.
+
+Panic set in, a palpable thing that seemed to suffocate the very air around her. She could hear the distant screams and shouts of the other passengers, the sounds of chaos echoing through the darkened corridors.
+
+In the blackness, Six felt a strange sense of calm. She'd always known this day would come. The adults had tried to keep it from them, but the children had their own ways of knowing. They'd felt the ship's slow decay, the gradual slide into oblivion.
+
+She closed her eyes, taking a deep breath, and let the darkness envelop her. When she opened them again, she saw it: a pinprick of light in the distance, growing larger by the second. It was a star, a beacon in the void, and it was pulling them in.
+
+The ship lurched again, and Six felt herself being pulled towards the light. She gripped the railing tighter, her knuckles turning white. She didn't know what awaited them at the end of this journey, but she knew one thing for certain: it would be a new beginning.
+
+As the light grew brighter, she felt a spark of hope ignite within her chest. She was the last of her kind, a child of the stars, and she would not go quietly into the night. She would fight, and she would survive, no matter the cost.
+
+The ship groaned and shuddered, and Six felt herself slipping. She let out a cry, her voice lost in the cacophony of the dying vessel. And then, as suddenly as it had begun, the movement stopped. The light was blinding now, filling the observation deck with a warm, golden glow.
+
+Six shielded her eyes, squinting into the brightness. She could see the outline of a planet, a small blue dot in the distance. It was beautiful, and terrifying, and it was their only hope.
+
+She knew what she had to do. She had to find the others, the other children who had been left to fend for themselves. Together, they would face whatever awaited them on this new world. They would build a new society, one that would not make the same mistakes as the old.
+
+With a newfound determination, Six pushed herself away from the railing and stumbled towards the door. The ship was still, the screams and shouts replaced by an eerie silence. She knew the adults would be in a panic, trying to regain control, to find a way to save themselves.
+
+But Six knew the truth. They were already lost. It was up to her, and the others like her, to forge a new path.
+
+As she stepped into the darkened corridor, she felt a strange sense of purpose settle over her. She was no longer just an orphan, a child of the ship. She was a pioneer, a survivor. She was the future.
+
+And with that thought, she began her journey towards the light.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty Sci-fi trilogy in the style of Frank Herbert and James S. A. Corey. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is an astronaut living on a space station orbiting the earth. The day starts off normally, but then him the others notice the mushroom clouds and they have to face inevitability of the situation they are in.
+
+### ASSISTANT
+ Chapter 1: The Silent Dawn
+
+Captain Johnathan "Jon" Harker floated through the narrow corridors of the space station, his movements precise and practiced. The hum of the life support systems and the distant chatter of his crew were the only sounds that filled the void around him. He glanced out of the porthole, the Earth a beautiful blue marble suspended in the inky blackness of space. The sun was rising over the Pacific, casting a warm glow on the station's solar panels. It was a sight he never tired of, no matter how many times he saw it.
+
+Jon's thoughts drifted to his family back home. He wondered what they were doing at that very moment. Were they still asleep, or had they already started their day? He longed to be there with them, to feel the warmth of the sun on his face and the embrace of his wife's arms. But duty called, and he was here, a hundred miles above the surface, watching over the planet that had given him life.
+
+As he entered the command module, he was greeted by the smell of freshly brewed coffee and the sight of his second-in-command, Lieutenant Sarah Reynolds, already at her station, her eyes scanning the monitors.
+
+"Morning, Jon," she said, her voice crisp and professional. "Anything interesting on the horizon?"
+
+Jon shook his head, smiling at her attempt to lighten the mood. "Just another day in paradise, Sarah."
+
+He took his seat and began his own morning routine, checking the status of the various systems and running through the day's schedule. It was a monotonous task, but one that had to be done. The station was their home, and like any home, it required constant maintenance.
+
+As he sipped his coffee, he couldn't shake the feeling that something was off. It was a feeling he'd had before, a sixth sense that had saved his life more than once during his years in the military. He scanned the monitors again, looking for any sign of trouble.
+
+And then he saw it. A series of bright flashes on the Earth's surface, like fireworks on a grand scale. But these were no celebrations. They were mushroom clouds, blooming like deadly flowers in the atmosphere.
+
+"Sarah," he said, his voice barely above a whisper. "Take a look at this."
+
+She followed his gaze, her eyes widening in horror as she saw the same thing. "My God," she breathed. "What is it?"
+
+Jon's mind raced as he tried to make sense of what he was seeing. "I don't know," he said, his voice tight with tension. "But it's not good."
+
+He keyed the comms, his fingers trembling slightly. "All hands, this is the captain. I need everyone in the command module, now."
+
+The rest of the crew floated in, their faces a mix of confusion and concern. Jon pointed to the monitors, and the room fell silent as they watched the devastation unfold.
+
+"What's happening?" someone asked, their voice barely audible.
+
+Jon took a deep breath, trying to steady himself. "I don't know," he said again. "But we need to find out."
+
+He turned to the communications officer, a young man named Thompson. "Try to raise Houston," he ordered. "See if they know anything."
+
+Thompson nodded, his hands shaking as he worked the controls. But there was only static in response.
+
+Jon's heart sank. He knew what that meant. They were on their own.
+
+As the minutes ticked by, the mushroom clouds continued to grow, spreading out like a dark stain on the face of the Earth. The crew watched in stunned silence, their faces pale and drawn.
+
+"We need to get closer," Jon said, his voice hard. "I want a better look at what's going on down there."
+
+Reynolds nodded, her fingers flying over the controls. The station's engines roared to life, and they began their descent.
+
+As they drew nearer, the true scale of the destruction became apparent. Cities were gone, replaced by smoldering craters. The once-blue sky was now a sickly yellow, choked with smoke and ash.
+
+Jon's thoughts turned to his family again. Were they among the dead? Or were they still alive, struggling to survive in a world that had been torn apart?
+
+He pushed the thoughts aside, focusing on the task at hand. They had to find out what had happened, and if there was any way they could help.
+
+But as they continued their descent, they received a transmission that chilled them to the bone. It was a garbled message, barely audible over the static. But the words were clear enough.
+
+"This is Earth Control. All space-based assets are to remain in orbit. Do not attempt reentry. Repeat, do not attempt reentry. The surface is... contaminated. God help us all."
+
+The silence in the command module was deafening. They were trapped, orbiting a dead world. Their home was gone, and there was no going back.
+
+Jon looked around at his crew, their faces mirroring his own despair. They were the last of humanity, adrift in the cold void of space.
+
+And then, a voice broke through the silence. It was Thompson, his eyes wide with fear.
+
+"Captain," he said, his voice shaking. "I'm picking up more launches. From all over the world."
+
+Jon's heart skipped a beat. "More nukes?"
+
+Thompson shook his head. "No, sir. These are different. They're heading... they're heading out. Away from Earth."
+
+Jon's mind raced. Who would do such a thing? And why?
+
+But then, he remembered the rumors. The whispers of a secret project, a last-ditch effort to save humanity in the event of a global catastrophe.
+
+"Sarah," he said, his voice barely above a whisper. "Plot a course. We're going after them."
+
+She looked at him, her eyes filled with a mix of hope and fear. "But, sir, our orders..."
+
+"To hell with our orders," Jon snapped. "We're not just going to sit here and watch our species die. We're going to find out what's happening, and we're going to do something about it."
+
+The crew exchanged glances, but no one argued. They knew their captain was right. They were the last hope for humanity, and they couldn't just sit by and do nothing.
+
+As they set a course for the unknown, Jon couldn't help but wonder what awaited them. Would they find a way to save their people, or would they join them in the cold embrace of oblivion?
+
+Only time would tell. But one thing was certain: their lives would never be the same again.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty Sci-fi trilogy in the style of Frank Herbert and James S. A. Corey. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a worker constructing a biodome when a terrible accident happens. Make the story very dark; no happy ending here...
+
+### ASSISTANT
+ Chapter 1: The Biodome's Lament
+
+The air was thick with the scent of sweat and burnt metal as the construction crew toiled under the unforgiving gaze of the alien sun. The planet, a desolate rock named Elysium-6, was a far cry from the lush greenery of Earth, but it was the best humanity had found in the endless void of space. The workers, clad in bulky exosuits, moved with a mechanical grace, their every motion a testament to the ingenuity of mankind's survival instinct.
+
+Among them was Kael, a man whose face was etched with the lines of a thousand hardships. He was a veteran of the construction crews, having helped build the first biodomes on Elysium-3 and Elysium-4. The work was grueling, but it was a small price to pay for the chance to breathe fresh air and feel the warmth of the sun on his skin, even if it was through layers of protective glass and polymer.
+
+As he welded the final support beam into place, Kael couldn't help but feel a sense of pride. This biodome would be his magnum opus, a testament to the resilience of the human spirit. It would be a sanctuary for the weary colonists, a place where they could grow food and raise their children without fear of the harsh elements outside.
+
+But as he stepped back to admire his handiwork, the ground beneath him began to tremble. The other workers looked up, their eyes wide with fear as the rumbling grew louder. Kael's heart sank as he realized what was happening.
+
+"Evacuate!" he bellowed into his suit's comms, but it was too late. The biodome, still incomplete, began to buckle and collapse in on itself. The sound of shattering glass and twisting metal filled the air as the structure imploded, burying Kael and his crew beneath a mountain of debris.
+
+Kael's world went dark as his suit's systems scrambled to compensate for the sudden change in pressure. He could feel the weight of the wreckage pressing down on him, crushing the breath from his lungs. Panic set in, and he struggled against the unyielding mass, but it was no use. He was trapped.
+
+As the oxygen in his suit began to dwindle, Kael's mind raced. He thought of his wife and daughter, who were waiting for him back at the colony. He thought of the life they had left behind on Earth, of the promise of a new beginning that had brought them to this forsaken rock. He thought of the countless hours he had spent away from them, working to build a future that now seemed so fragile and fleeting.
+
+And then, he thought of the darkness. The all-consuming, suffocating darkness that was slowly enveloping him. It was a familiar feeling, one that had haunted his dreams since childhood. He had always been afraid of the dark, of the unknown that lurked just beyond the reach of his sight. Now, it seemed that the darkness had come to claim him for its own.
+
+As his vision began to fade, Kael's thoughts turned to the Spice, the precious resource that had brought humanity to this corner of the galaxy. It was said to have the power to unlock the secrets of the universe, to grant those who harnessed it unimaginable abilities. But at what cost? The Spice had turned the planets of the Elysium system into barren wastelands, and now it threatened to take his life as well.
+
+He could hear the faint cries of his crewmates, their voices distorted by the static of their failing comms. He wanted to reach out to them, to offer some measure of comfort, but he knew it was futile. They were all going to die here, buried beneath the wreckage of their dreams.
+
+And then, as if in answer to his unspoken prayer, a voice cut through the chaos. It was calm and soothing, like a cool breeze on a hot day. It spoke to him in a language he didn't understand, but somehow, he knew what it was saying.
+
+"Embrace the darkness, Kael," it whispered. "It is the only way to find the light."
+
+With a final, desperate effort, Kael reached out with his mind, seeking the source of the voice. He felt a strange energy coursing through him, a power that seemed to defy the very laws of nature. It was the Spice, he realized, responding to his desperation. It was offering him a chance, a slim hope of survival.
+
+He took a deep breath, willing himself to let go of his fear. The darkness closed in around him, and for a moment, he was lost. But then, he felt a warmth spreading through his body, a sense of peace that he had never known before. The weight of the debris seemed to lessen, and he could breathe again.
+
+When Kael opened his eyes, he found himself floating above the wreckage, his suit's systems miraculously restored. He looked down at his hands, which glowed with an ethereal light. The Spice had chosen him, had given him the power to save himself and his crew.
+
+But as he reached out to free his comrades, he couldn't shake the feeling that he had made a deal with the devil. The voice in his head was still there, whispering dark secrets and promising even greater power. It was a seductive offer, one that he knew he could never refuse.
+
+As the survivors stumbled out of the wreckage, coughing and gasping for air, Kael knew that their ordeal was far from over. The Spice had awakened something within him, something that would change the course of their lives forever.
+
+And as they looked to him for guidance, he couldn't help but wonder if they would ever be able to trust him again. For in the depths of his soul, he could feel the darkness growing, threatening to consume him whole.
+
+This was just the beginning of a long and treacherous journey, one that would take them to the very edge of the known universe and beyond. And as they set out to rebuild their shattered lives, Kael knew that the true test of their mettle was yet to come.
+
+For in the darkness of space, there were forces at work that even the Spice could not control. Forces that would stop at nothing to claim the power that now flowed through his veins. Forces that would tear apart the very fabric of reality to get what they wanted.
+
+And as the first tendrils of doubt began to creep into his mind, Kael couldn't help but wonder if they were already too late. If the darkness had already won.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty Sci-fi trilogy in the style of Frank Herbert and James S. A. Corey. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is manning a listening station in deep space. What he hears over the radio chills him to the bone.
+
+### ASSISTANT
+ Chapter 1: The Whispers of the Void
+
+The darkness of space was a constant companion to Lieutenant Kael, a vast and unending expanse that stretched out before him like an inky ocean. He had grown used to its silence, the gentle hum of the listening station his only solace in the void. But today, the silence was broken.
+
+Kael sat hunched over the console, his fingers dancing across the controls with practiced ease. The station's AI, a sophisticated piece of machinery named ECHO, hummed softly in the background, its green lights casting an eerie glow on his pale face. He had been stationed here for months, listening for any signs of life, any whispers from the void that might hint at the location of the enemy. The war had been raging for years, and the listening posts were the first line of defense against the encroaching darkness.
+
+Suddenly, a blip on the screen caught his eye. A signal, faint but unmistakable, echoed through the speakers. He leaned in closer, his heart pounding in his chest. It was a voice, human, desperate, and filled with terror.
+
+"Mayday, mayday," the voice crackled, barely audible over the static. "This is the SS Artemis. We are under attack. Coordinates... 47.3.9 by 12.6.5. Repeat, we are under attack."
+
+Kael's hands trembled as he input the coordinates into the system. The Artemis was a research vessel, one of the many that had been sent out to explore the far reaches of the galaxy in search of a new home for humanity. They were unarmed, defenseless against the enemy that now hunted them.
+
+He keyed the mic, his voice steady despite the fear that gripped him. "SS Artemis, this is Listening Post Alpha. We have received your distress signal. Please confirm your identity and status."
+
+There was a pause, then the voice returned, weaker this time. "This is Dr. Elara Sinclair, chief scientist aboard the Artemis. Our ship has been breached. We have... casualties. Requesting immediate assistance."
+
+Kael's mind raced. He was alone on this station, a single man against the vastness of space. He couldn't offer any help, not directly. But he could alert the fleet, send them to the Artemis' aid. He reached for the emergency beacon, his hand hovering over the button.
+
+But then, the voice changed. The desperation was gone, replaced by a cold, mechanical tone. "Lieutenant Kael, do not send the signal. You must not alert them to our presence."
+
+Kael froze, his heart skipping a beat. How did they know his name? How could they possibly know where he was? He glanced at the screen, the signal's origin still displayed in bright red letters. It was coming from the Artemis, but it wasn't Dr. Sinclair's voice anymore.
+
+"Who is this?" he demanded, his voice barely above a whisper.
+
+"We are the ones you have been searching for," the voice replied, a chilling smile evident in its tone. "We are the darkness that consumes the stars. And now, we have found you."
+
+Kael's mind reeled as he tried to process the implications. The enemy had infiltrated the Artemis, taken control of its systems, and was now using it to lure the fleet into a trap. He couldn't let that happen. He had to warn them, had to do something.
+
+But as he reached for the beacon again, a hand gripped his wrist, cold and unyielding. He looked up, his eyes widening in horror as he saw Dr. Sinclair standing behind him, her eyes black and empty, her mouth twisted into a grotesque smile.
+
+"You must not interfere," she said, her voice still that of the machine. "Join us, Lieutenant Kael. Embrace the darkness."
+
+He tried to pull away, but her grip was like iron. He could feel the cold seeping into his bones, numbing him, sapping his strength. He struggled, but it was no use. The darkness was closing in, and he knew he was losing the battle.
+
+As the last of his will faded, he heard the voice in his head, a whisper that seemed to come from all around him. "We are Legion, and we are coming."
+
+And then, the station was plunged into silence once more, the only sound the distant hum of the engines and the beating of his own terrified heart.
+
+</details>
+
+## Miscellaneous stories
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty post-apocalyptic novel in the style of Cormac McCarthy. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a technician in a nuclear bunker 18 months after the war. The 12 inhabitants of the bunker have been expecting to start to be able to leave soon, but it has just been discovered that at least where they are, salted cobalt bombs were used. It's clear now that either all 12 will die when the resources run out and their is barely enough for 6 to make it to 5 years and have any hope of leaving. After 18 months of calm everything breaks lose today.
+
+### ASSISTANT
+ The technician, known only as 7, sat hunched over the console, his fingers tracing the lines of data that scrolled across the screen. The hum of the bunker's machinery was a constant, comforting presence, a reminder that they were still alive, still safe. Or so they had thought.
+
+He had been the one to find it, the anomaly in the readings. The air outside, once thought to be slowly healing, was now revealed to be a toxic wasteland, poisoned by salted cobalt bombs. The news had spread like wildfire through the bunker, igniting a panic that threatened to consume them all.
+
+7 closed his eyes, trying to block out the chaos that had erupted around him. He could hear the voices of the others, raised in anger and fear, but they seemed distant, muffled by the weight of his own thoughts. He had always known that their situation was precarious, that their survival was a fragile thing, but this... this was a nightmare he had never dared to imagine.
+
+The bunker had been designed to sustain twelve people for five years. They had been careful, rationing their food and water, conserving their energy. They had even managed to create a small garden, a green oasis in the sterile underground world. But now, with the truth of their situation laid bare, it was clear that they had been living on borrowed time.
+
+The air recyclers would not be able to filter out the cobalt. The crops would wither and die. And they, the last remnants of humanity, would be trapped in this tomb of steel and concrete, waiting for the slow, agonizing end.
+
+He opened his eyes and looked around the control room. The others were gathered there, their faces a tableau of despair and desperation. The leader, a man named Thompson, was trying to restore order, his voice rising above the din. But it was like trying to hold back a flood with a single hand.
+
+"We have to make a decision," Thompson said, his voice strained. "We can't keep going like this. We can't just... just wait to die."
+
+7 felt a cold knot form in his stomach. He knew what was coming, the inevitable calculus of survival. There were twelve of them, but the resources were only enough for six. They would have to choose who would live and who would die.
+
+He thought of the others, the men and women he had come to know in the long months underground. The doctor, who had patched him up more times than he could count. The engineer, who had kept the bunker's systems running despite the constant failures and breakdowns. The cook, who had managed to make their meager rations taste like something other than sawdust and despair.
+
+And he thought of the children, the three of them, who had been born into this world of darkness and uncertainty. They had never seen the sun, never felt the wind on their faces, never known anything but the confines of the bunker. Was it fair to condemn them to this slow, suffocating death?
+
+He looked down at his hands, the knuckles white as he gripped the edge of the console. He had always prided himself on his logic, his ability to see things clearly, to make the hard choices. But now, faced with the reality of their situation, he found himself paralyzed.
+
+The voices around him grew louder, more insistent. He could hear the whispers of names, the quiet calculations of who was expendable and who was not. He knew that his own name was among them, that his skills as a technician were not as valuable as the strength of a soldier or the knowledge of a scientist.
+
+He closed his eyes again, trying to shut out the world, trying to find some semblance of peace in the chaos. But all he could see was the darkness outside, the endless expanse of poisoned earth that awaited them all.
+
+And then, from somewhere deep within him, a spark of defiance ignited. He would not go quietly into that dark night. He would not let them decide his fate, or the fate of the others. He would find a way to save them all, or die trying.
+
+He stood up, his legs shaking, and pushed his way through the crowd. He had to find a solution, had to find a way to fix this. He would not let them give up, not without a fight.
+
+As he made his way to the back of the control room, he felt a hand on his arm. He turned to see the doctor, her eyes filled with a mixture of sadness and determination.
+
+"I know what you're thinking," she said, her voice barely above a whisper. "But you can't save us all."
+
+7 looked at her, his heart pounding in his chest. He wanted to argue, to tell her that he would find a way. But he knew she was right. The math was simple, brutal in its finality.
+
+"Then I'll save as many as I can," he said, his voice hoarse.
+
+She nodded, a small, sad smile playing at the corners of her mouth. "That's all any of us can do," she said.
+
+And with that, he turned and walked away, leaving the control room and the arguing survivors behind. He had work to do, plans to make. The end was coming, and he would not meet it without a fight.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a historical mystery novel in the style of Arturo Pérez-Reverte and Umberto Eco. The story starts off in California during the 1948 Gold Rush, before moving to London in the mid 1970s. There should be a mysterious 'occult' item that connects these two time periods.
+
+### ASSISTANT
+ Chapter 1: The Golden Thread
+
+The year was 1848, and the air in California was thick with the scent of gold and the sweat of men. The Gold Rush had brought a motley crew of dreamers, desperadoes, and scholars to the once-tranquil land, all united by the insatiable lust for the precious metal that glittered in their eyes. Among them was a man named Alistair Blackwood, a British antiquarian with a penchant for the esoteric and a keen eye for the extraordinary.
+
+Blackwood had arrived in San Francisco not with a pickaxe and a pan, but with a leather-bound journal and a worn-out compass. He was in pursuit of a legend, a tale whispered in the dark corners of London's most exclusive clubs: the story of the Golden Spindle, an ancient artifact said to possess the power to spin the very fabric of time. The journal, penned by a long-lost alchemist, held cryptic clues to its whereabouts, and the compass, a family heirloom, was rumored to point towards the object of one's deepest desire.
+
+In the bustling streets of the city, Blackwood found himself drawn to a peculiar shop, nestled between a saloon and a general store. The sign above the door creaked in the wind, bearing the image of an ouroboros, the serpent eating its own tail, a symbol of eternity. The shopkeeper, a wizened old man with a silver beard and eyes that seemed to hold the wisdom of the ages, greeted him with a knowing smile.
+
+"You've come a long way, Mr. Blackwood," the old man said, his voice a low rumble. "I've been expecting you."
+
+Blackwood raised an eyebrow, taken aback. "How do you know my name?"
+
+The shopkeeper chuckled, producing a small golden spindle from beneath the counter. "The Spindle has a way of drawing those who seek it. And you, my friend, have been seeking it for quite some time."
+
+As Blackwood reached out to touch the object, the world around him seemed to blur. He saw visions of a different time, a different place: the cobblestone streets of London, the Thames shrouded in fog, and the silhouette of a towering cathedral. The spindle was warm to the touch, pulsating with an energy that seemed to resonate within his very soul.
+
+"Careful," the shopkeeper warned. "The Spindle is not a toy. It is a tool, and a dangerous one at that. It can weave the threads of fate, but it can also unravel them."
+
+Fast forward to London, 1975. The city was a far cry from the grimy, gas-lit streets of Blackwood's vision. The air was thick with the smell of exhaust fumes and the sound of punk rock. Amidst the chaos, a young woman named Isabella found herself drawn to a dusty old bookshop, much like the one that had once housed the Golden Spindle.
+
+Isabella was an amateur historian, a seeker of truth in a world that seemed to have forgotten it. She had stumbled upon Blackwood's journal in the archives of the British Museum, and the tale of the Golden Spindle had consumed her every waking thought. The journal had led her to this very shop, and the mysterious old man who now stood before her.
+
+"You have the eyes of a believer," he said, handing her a small, leather-bound book. "This is the key to unlocking the Spindle's secrets."
+
+Isabella opened the book, and as she read the first page, the world around her seemed to shift. She was no longer in the cluttered bookshop, but in a dimly-lit room filled with ancient artifacts. A figure stood before her, his back turned, examining a golden spindle that seemed to glow with an otherworldly light.
+
+"Alistair?" she whispered, her voice barely audible.
+
+The figure turned, and she saw that it was indeed Blackwood, but older, wearier. He looked at her with a mixture of surprise and recognition.
+
+"Who are you?" he demanded. "How do you know my name?"
+
+"I've been following your trail," Isabella replied, her voice trembling. "I've read your journal. I know about the Spindle."
+
+Blackwood's eyes widened, and he took a step back. "Impossible. I've guarded its secrets for over a century."
+
+"Then you must help me," Isabella pleaded. "The Spindle is in danger. I've seen it in my dreams, in the hands of those who would use it for evil."
+
+Blackwood hesitated, then nodded. "Very well. But first, you must understand the true nature of the Spindle, and the price that must be paid for its power."
+
+And so, the unlikely duo embarked on a journey through time and space, unraveling the threads of history to protect the Golden Spindle from those who would seek to control the very fabric of existence. From the wild west to the grimy streets of Victorian London, from the halls of the British Museum to the depths of the Vatican archives, they would uncover a web of secrets and lies that spanned centuries, all connected by the golden thread of the Spindle's mysterious power.
+
+As they delved deeper into the mystery, they would discover that the true enemy was not the men who sought the Spindle, but the force that had created it: an ancient, malevolent entity that had been manipulating the course of human history for its own inscrutable ends. And as they raced to unravel the final threads of the Spindle's dark past, they would find themselves caught in a deadly game of cat and mouse, with the fate of the world hanging in the balance.
+
+For the Golden Spindle was not just a tool, but a weapon, and the one who wielded it would hold the power to shape the future as they saw fit. And as the threads of time began to fray, Isabella and Blackwood would have to decide: would they use the Spindle to rewrite history, or would they destroy it to save the world?
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty historical novel set during the battle of the Bulge. Write in first person. The POV character for Chapter 1 is a young German officer trying to carry his wounded commander back to the deep defensive line after the bunker he was in was overrun. He should have a flashback to the moment it was overrun during the middle of the story. The story should not end well for either of them.
+
+### ASSISTANT
+ Chapter 1: The Frozen Hell
+
+The cold bit into my bones, a relentless predator seeking to claim me as its next victim. The weight of my commander, a once proud and formidable man, now a broken and bleeding mess, threatened to pull me under the snow. I gritted my teeth and pressed on, my breaths coming in ragged gasps. The howling winds of the Ardennes Forest screamed in my ears, a chorus of the damned, urging me to give up, to let him go. But I couldn't. I wouldn't.
+
+"Komm, mein Sohn," he mumbled, his voice barely audible over the cacophony of the storm. "We must...we must reach the line."
+
+I nodded, my jaw clenched tight. The words of encouragement from my commander, a man I had come to respect and fear in equal measure, gave me a semblance of strength. I adjusted my grip on his arm, feeling the warmth of his blood seeping through my gloves, and stumbled forward.
+
+A flash of memory, a nightmare reborn, seized me. The bunker, our sanctuary against the relentless American onslaught, was a chaos of screams and gunfire. The acrid smell of smoke and cordite filled the air, choking the life from our lungs. I saw the fear in the eyes of my comrades, the desperation etched on their faces as they fought to hold back the tide of enemy soldiers.
+
+A grenade exploded, the concussive force sending me sprawling. I remember the deafening silence that followed, the ringing in my ears a cruel reminder that I was still alive. Through the haze, I saw him, my commander, pinned beneath a fallen beam, his leg a twisted mess of bone and flesh.
+
+"Leave me!" he had roared, his face contorted in agony. "Save yourselves!"
+
+But I couldn't. I wouldn't. I was his officer, his responsibility, and I would not abandon him to this frozen hell. I had dragged him from the wreckage, ignoring his protests, and together we had stumbled into the night, the sounds of battle fading behind us.
+
+Now, as we trudged through the snow, the world around us a blur of white and darkness, I could feel his grip on my arm weakening. I stumbled, falling to my knees, and he slumped against me, his head lolling to the side.
+
+"Sir?" I whispered, my voice hoarse from the cold and the strain. "Sir, please, we must keep moving."
+
+He didn't respond. I felt for a pulse, my fingers trembling, and found it, weak and thready. I took a deep breath, the cold air searing my lungs, and heaved him back onto my shoulders.
+
+The wind howled, a mournful wail that seemed to carry the voices of the dead. I staggered on, my legs burning with the effort, my heart pounding in my chest. The deep defensive line was close, I could feel it. We just had to make it a little further.
+
+But the storm was merciless, and the darkness complete. I lost my bearings, my sense of direction, and soon I was stumbling blindly through the forest, my commander's body a dead weight on my back.
+
+And then, the unthinkable. A figure loomed out of the darkness, a silhouette against the white. An American soldier, his rifle trained on me. I dropped to my knees, my commander slipping from my grasp, and raised my hands in surrender.
+
+"Don't shoot," I croaked, my voice barely audible. "Wounded...medic."
+
+The soldier approached, his boots crunching in the snow. He knelt beside us, his face a mask of disbelief and horror as he took in the state of my commander. He hesitated, then reached for his radio.
+
+"I've got a German officer and a wounded man here," he said, his voice cracking with the cold. "Requesting medics."
+
+I closed my eyes, relief washing over me. We had made it. We were going to survive.
+
+But fate is a cruel mistress. As the soldier turned back to us, a shot rang out, and he crumpled to the ground, a red blossom spreading across his chest. I looked up, my heart in my throat, to see a shadowy figure retreating into the trees.
+
+A deserter. A traitor. One of our own.
+
+I crawled to my commander, cradling his head in my lap. His breaths were shallow, his eyes glassy. He looked up at me, a faint smile on his lips.
+
+"You did well, mein Sohn," he whispered, his voice barely a breath. "You did well."
+
+And then, he was gone. The life drained from his body, leaving me alone in the frozen hell of the Ardennes Forest, with nothing but the howling wind and the distant sounds of battle for company.
+
+I sat there, in the snow, holding the body of the man who had been my commander, my friend, my responsibility. And I wept. For him, for me, for the senselessness of it all.
+
+The cold seeped into my bones, numbing my body, my mind. I knew I couldn't stay there, couldn't give in to the darkness that threatened to consume me. But as I looked down at the man in my arms, I couldn't find the strength to move.
+
+And so, I sat, and I waited. For the Americans to find me. For the end to come.
+
+For the mercy of the frozen hell.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me a short story about the fictional character of Anton Chigurh. It should be written in third person personal and feature internal monologues of his deranged world view. The time period is around 2 years before the events in Cormac McCarthy's 2005 novel 'No Country for Old Men'. It should be set in Mexico, be very dark, show Anton's still developing obsession with "chance" and feature a grenade. The story should start with him waiting in a bar for instructions on the "job" he is to perform.
+
+### ASSISTANT
+ Anton Chigurh sat in the dimly lit corner of the bar, his eyes scanning the room with a cold, calculated precision. The air was thick with the smell of stale cigarette smoke and cheap tequila, a fitting backdrop for the kind of business that was about to transpire. He ran his fingers through his greasy, black hair, feeling the weight of the grenade in his pocket. It was a comforting sensation, a reminder of the chaos he could unleash at a moment's notice.
+
+His thoughts drifted to the concept of chance, a notion that had begun to consume him in recent months. He believed in the randomness of the universe, in the idea that every action, every decision, was merely a roll of the dice. It was a belief that had led him down a dark and violent path, one that he walked with a chilling sense of purpose.
+
+The bartender, a portly man with a sweat-stained shirt, eyed him warily as he approached. "What'll it be?" he asked, his voice thick with an accent that spoke of a life spent in the dusty border towns of Mexico.
+
+"Water," Chigurh replied, his voice barely above a whisper. The bartender nodded and slid a glass across the counter, his eyes never leaving the stranger's face.
+
+As he sipped his water, Chigurh's mind turned to the job at hand. He had been hired to retrieve a briefcase, a simple task that should have been completed days ago. But the man who had been carrying it had proven to be more resourceful than expected, and now Chigurh found himself in this godforsaken place, waiting for instructions on how to proceed.
+
+He glanced at his watch, the ticking of the second hand a metronome to his impatience. Time was a construct, he thought, a human attempt to impose order on the chaos of the universe. But even he had to admit that there was a certain beauty in the way it could be manipulated, used to his advantage.
+
+A man entered the bar, his eyes scanning the room before settling on Chigurh. He was the contact, the one who would give him the information he needed. The man approached, sliding a folded piece of paper across the table. Chigurh opened it, his eyes scanning the hastily scrawled address.
+
+"You know what to do," the man said, his voice low and urgent. Chigurh nodded, his fingers closing around the paper. The man left as quickly as he had come, disappearing into the night.
+
+Chigurh stood, leaving a few crumpled bills on the table. He made his way to the door, the weight of the grenade in his pocket a constant reminder of the power he held. As he stepped outside, he felt the cool night air on his face, a welcome relief from the stifling heat of the bar.
+
+He walked to his car, a nondescript sedan that blended in with the other vehicles on the street. As he drove, his thoughts returned to chance. He believed that every decision, every action, was a coin flip, a roll of the dice. And yet, he couldn't shake the feeling that there was something more, some unseen force guiding his hand.
+
+He arrived at the address, a run-down motel on the outskirts of town. He could feel the tension in the air, the sense that something was about to happen. He approached the room, his heart beating a steady rhythm in his chest.
+
+He took a deep breath, steadying himself. He reached into his pocket, his fingers closing around the grenade. He pulled the pin, the sound of the metal clicking against the casing echoing in his ears. He tossed it into the room, the explosion rocking the building.
+
+As he walked away, the sound of sirens in the distance, he couldn't help but smile. Chance had been on his side tonight. But he knew that it was a fickle mistress, one that could turn on him at any moment. And that was what made the game so thrilling.
+
+He climbed into his car, the adrenaline still coursing through his veins. He started the engine, the headlights cutting through the darkness. As he drove away, he couldn't help but wonder what the next roll of the dice would bring.
+
+</details>
+
+Big thanks to: @sophosympatheia for working out the merge pattern, @Sao10K for creating Euryale and WinterGoddess, and @chargoddard for writing [Mergekit](https://github.com/arcee-ai/mergekit)!

config.json

@@ -0,0 +1,39 @@
+{
+    "architectures": [
+        "LlamaForCausalLM"
+    ],
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "bos_token_id": 1,
+    "eos_token_id": 2,
+    "hidden_act": "silu",
+    "hidden_size": 8192,
+    "initializer_range": 0.02,
+    "intermediate_size": 28672,
+    "max_position_embeddings": 32764,
+    "model_type": "llama",
+    "num_attention_heads": 64,
+    "num_hidden_layers": 80,
+    "num_key_value_heads": 8,
+    "pad_token_id": 0,
+    "pretraining_tp": 1,
+    "rms_norm_eps": 1e-05,
+    "rope_scaling": null,
+    "rope_theta": 1000000,
+    "tie_word_embeddings": false,
+    "torch_dtype": "float16",
+    "transformers_version": "4.39.3",
+    "use_cache": true,
+    "vocab_size": 32000,
+    "quantization_config": {
+        "quant_method": "exl2",
+        "version": "0.0.21",
+        "bits": 6.5,
+        "head_bits": 6,
+        "calibration": {
+            "rows": 100,
+            "length": 2048,
+            "dataset": "wiki2.parquet"
+        }
+    }
+}

huggingface-metadata.txt

@@ -0,0 +1,20 @@
+url: https://huggingface.co/jukofyork/Dusk-Miqu-70B
+branch: main
+download date: 2024-06-10 16:11:40
+sha256sum:
+    7da46999bcd49094213373dfce526554e2a99cff7fef4fbab88f8a021f689098 model-00001-of-00015.safetensors
+    7b9c760c2ef3c24de6a6694dc0bacdf124ded26d37e53e675ea7d6bc03284c59 model-00002-of-00015.safetensors
+    716341e8532d6fec6174d008c23e0ee4242d4e619030ce44a6a6f620fd8a962a model-00003-of-00015.safetensors
+    4e645962d04a2dab56723b597516cda5928fd59831bba1698cc8093ff70a343b model-00004-of-00015.safetensors
+    6781036fae6f6ce991c7b9870159698e2903bea3d25b263e2b27a12692a1c6ea model-00005-of-00015.safetensors
+    4a0afba1aea84778467f9a370db03f2afcf5a4a27ca2e1067bb6d6a01166575e model-00006-of-00015.safetensors
+    c816141633d7cc8871e4f41e3b3913ca0f19c05d35296846721501174c502b03 model-00007-of-00015.safetensors
+    f0dcc86541dec657ed3fbf5013f202d287c36cd87344d4ea2e27901277ea19a5 model-00008-of-00015.safetensors
+    75b793b353316d8de2d26e35e225b01908c43924b21bebd712027c6a19747fc8 model-00009-of-00015.safetensors
+    6effcb7b77757bf041fe17c73fdd9172f1446b92b7c84d88b1b9fa0db719c302 model-00010-of-00015.safetensors
+    13f9b47a8ce4d5089b893283fa2ce91319d1ce7feaea05ba6d44211e7217bbac model-00011-of-00015.safetensors
+    44e82c001b124c1f77dedaf0a5dafb3d718e9648a504a7bd1c3045e2b9314fba model-00012-of-00015.safetensors
+    eafbd65fe9a246df7b6b47a6370d385707290d5e781bed7bb0038729a78fff35 model-00013-of-00015.safetensors
+    ea6705de902ea829bdc4b6516b5b26dfe4f89939a59bf908865e465a434e492c model-00014-of-00015.safetensors
+    62ee6037a95c66861f7910a82168886a63e071750d4872ad43c980c724c68de2 model-00015-of-00015.safetensors
+    9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347 tokenizer.model

model.safetensors.index.json

@@ -0,0 +1 @@
+{"metadata": {"mergekit_version": "0.0.4.2", "total_size": 137953296384}, "weight_map": {"model.layers.2.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.0.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.embed_tokens.weight": "model-00001-of-00015.safetensors", "model.layers.5.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.5.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.5.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.5.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.4.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.3.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.3.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.2.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.2.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.19.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.19.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.19.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.19.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.16.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.16.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.16.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.16.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.16.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.8.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.8.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.8.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.7.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.6.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.6.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.5.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.5.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.5.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.5.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.5.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.24.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.22.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.22.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.22.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.21.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.21.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.21.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.21.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.21.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.21.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.21.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.21.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.21.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.20.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.20.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.20.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.20.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.20.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.20.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.20.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.20.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.20.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.19.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.19.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.19.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.19.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.19.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.18.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.18.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.18.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.18.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.18.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.18.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.18.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.18.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.18.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.17.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.17.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.17.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.17.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.17.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.17.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.17.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.17.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.17.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.16.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.16.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.16.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.16.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.10.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.10.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.10.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.10.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.10.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.10.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.10.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.10.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.10.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.9.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.9.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.9.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.9.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.9.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.9.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.9.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.9.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.9.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.8.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.8.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.8.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.8.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.8.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.8.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.30.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.30.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.30.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.30.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.30.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.27.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.27.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.27.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.27.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.27.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.27.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.26.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.26.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.26.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.26.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.26.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.26.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.26.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.26.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.26.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.25.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.25.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.25.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.25.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.25.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.25.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.25.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.25.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.25.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.24.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.24.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.24.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.24.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.24.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.24.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.24.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.24.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.23.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.23.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.23.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.23.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.23.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.23.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.23.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.23.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.23.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.22.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.22.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.22.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.22.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.22.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.22.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.13.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.13.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.13.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.13.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.13.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.13.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.12.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.12.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.12.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.12.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.12.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.12.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.12.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.12.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.12.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.11.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.11.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.11.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.11.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.11.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.11.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.11.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.11.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.11.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.36.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.36.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.36.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.35.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.35.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.33.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.33.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.33.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.33.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.32.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.32.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.32.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.32.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.32.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.32.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.32.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.32.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.32.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.31.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.31.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.31.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.31.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.30.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.30.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.30.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.30.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.29.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.29.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.28.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.28.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.27.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.27.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.27.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.15.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.15.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.15.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.15.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.15.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.15.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.15.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.15.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.15.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.14.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.14.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.14.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.14.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.14.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.14.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.14.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.14.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.14.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.13.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.13.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.13.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.41.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.41.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.41.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.41.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.41.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.38.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.37.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.37.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.36.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.36.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.36.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.36.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.36.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.36.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.35.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.35.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.34.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.34.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.33.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.33.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.33.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.33.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.33.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.47.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.47.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.47.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.47.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.46.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.46.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.46.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.46.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.44.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.44.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.44.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.44.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.44.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.43.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.42.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.42.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.41.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.41.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.41.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.41.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.40.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.40.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.39.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.39.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.52.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.52.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.50.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.50.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.50.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.49.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.48.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.48.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.47.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.47.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.47.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.47.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.47.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.46.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.46.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.46.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.46.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.46.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.45.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.45.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.44.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.44.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.44.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.44.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.58.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.58.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.58.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.58.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.58.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.57.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.57.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.post_attention_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.54.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.input_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.53.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.post_attention_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.53.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.input_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.51.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.post_attention_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.51.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.input_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.50.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.50.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.50.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.50.post_attention_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.50.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.50.input_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.63.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.mlp.gate_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.63.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.62.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.61.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.61.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.61.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.61.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.mlp.gate_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.60.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.59.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.mlp.gate_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.59.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.58.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.58.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.58.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.58.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.57.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.57.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.56.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.mlp.gate_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.56.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.55.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.55.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.55.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.62.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.62.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.61.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.61.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.61.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.61.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.61.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.64.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.66.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.65.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.65.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.64.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.64.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.69.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.68.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.68.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.68.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.68.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.67.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.67.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.72.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.72.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.72.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.72.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.72.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.71.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.70.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.70.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.69.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.69.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.69.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.75.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.75.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.75.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.75.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.74.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.73.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.73.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.73.self_attn.o_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.72.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.72.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.72.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.72.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.78.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.78.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.78.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.77.self_attn.o_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.76.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.76.self_attn.o_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.75.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.75.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.75.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.75.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.75.input_layernorm.weight": "model-00014-of-00015.safetensors", "lm_head.weight": "model-00014-of-00015.safetensors", "model.norm.weight": "model-00014-of-00015.safetensors", "model.layers.79.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.79.self_attn.o_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.78.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.78.mlp.gate_proj.weight": "model-00015-of-00015.safetensors", "model.layers.78.mlp.up_proj.weight": "model-00015-of-00015.safetensors", "model.layers.78.post_attention_layernorm.weight": "model-00015-of-00015.safetensors", "model.layers.78.self_attn.o_proj.weight": "model-00015-of-00015.safetensors", "model.layers.78.input_layernorm.weight": "model-00015-of-00015.safetensors"}}

special_tokens_map.json

@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
+size 499723

tokenizer_config.json

@@ -0,0 +1,42 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": true,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "legacy": false,
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<unk>",
+  "sp_model_kwargs": {},
+  "spaces_between_special_tokens": false,
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}