File size: 6,067 Bytes
a35b570 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 |
---
license: cc-by-nc-4.0
---
```
e88 88e d8
d888 888b 8888 8888 ,"Y88b 888 8e d88
C8888 8888D 8888 8888 "8" 888 888 88b d88888
Y888 888P Y888 888P ,ee 888 888 888 888
"88 88" "88 88" "88 888 888 888 888
b
8b,
e88'Y88 d8 888
d888 'Y ,"Y88b 888,8, d88 ,e e, 888
C8888 "8" 888 888 " d88888 d88 88b 888
Y888 ,d ,ee 888 888 888 888 , 888
"88,d88 "88 888 888 888 "YeeP" 888
PROUDLY PRESENTS
```
# Llama-3-8B-Instruct-DADA-exl2-rpcal
Quantized using 200 samples of 8192 tokens from an RP-oriented [PIPPA](https://huggingface.co/datasets/royallab/PIPPA-cleaned) dataset.
Branches:
- `main` -- `measurement.json`
- `8b8h` -- 8bpw, 8bit lm_head
- `6b6h` -- 6bpw, 6bit lm_head
- `4b6h` -- 4bpw, 6bit lm_head
Original model link: [Envoid/Poppy_Porpoise-DADA-8B](https://huggingface.co/Envoid/Poppy_Porpoise-DADA-8B)
Original model README below.
-----
# This is a [DADA tuned](https://huggingface.co/Envoid/Mixtral-Instruct-ITR-DADA-8x7B) version of [ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B)
### As always, experimental model, results may be unpredictable.
The intermediate merge model was finetuned specifically for the original model and then merged onto it via 50/50 SLERP merge.
As far as RP goes my current testing setup is having difficulties involving end of sequence and I found the prompt templates provided with Poppy Porpoise were not yielding desirable results on either the original model or the DADA tune so I opted instead to use Libra style Llama-3 prompt templates and simple sampling. The results, albeit subjective, I thought were good.
## Whether or not the tune had any effect on multi-modal capabilities was not part of the test and instead focus was entirely on creative writing.
Test: A simple instruct prompt utilizing determinsitic samplers.
**PROMPT**
```
Write me a 'beauty and the beast' gothic metal duet about a couple fighting over which brand of ketchup to purchase.
```
**Poppy Porpoise Original:**
```
(Verse 1 - Beauty)
In the land of condiments, where flavors reign supreme,
A tale of love and strife, a battle of the brands it seems.
I stand before the shelves, my heart aflame with desire,
For the perfect ketchup to complement my fries.
(Chorus)
But alas, my love, you stand beside me, with a different view,
Your heart set on [Brand 1 redacted], while mine beats for [Brand 2 redacted], it's true.
We clash in this aisle, our passions running high,
A Gothic metal duet, our love and hate collide.
(Verse 2 - Beast)
I've tasted both, and I know, [Brand 1 redacted] is the one for me,
Its tangy sweetness, a symphony, a harmony.
But you, my love, you cling to Hunt's, its flavor so bland,
A cacophony of mediocrity, a discordant band.
(Chorus)
But alas, my love, you stand beside me, with a different view,
Your heart set on [Brand 2 redacted], while mine beats for [Brand 1 redacted], it's true.
We clash in this aisle, our passions running high,
A Gothic metal duet, our love and hate collide.
(Bridge)
We're lost in this supermarket, a Gothic metal dream,
Our love and hate entwined, a twisted, tortured theme.
The ketchup bottles loom, like tombstones in the night,
A monument to our love, a testament to our fight.
(Chorus)
But alas, my love, you stand beside me, with a different view,
Your heart set on [Brand 2 redacted], while mine beats for [Brand 1 redacted], it's true.
We clash in this aisle, our passions running high,
A Gothic metal duet, our love and hate collide.
(Outro)
And so we stand, in this aisle of despair,
Our love and hate, a Gothic metal prayer.
For in the end, it's not the ketchup that matters,
But the love we share, in this twisted, tortured heart.
```
**Poppy Porpoise DADA**
```
(Verse 1 - Beauty)
In the land of condiments, where the sauces reign supreme,
A battle rages on, a war of ketchup dreams.
I stand by [Brand 1 redacted], the classic, the original, the best,
But my love, he's a rebel, he's a [Brand 2 redacted] pest.
(Chorus)
Oh, the ketchup wars, they rage on and on,
A tale of love and sauce, a battle to be won.
Will our love prevail, or will it be undone?
By the brand of ketchup, our hearts are torn asunder.
(Verse 2 - Beast)
[Brand 2 redacted], the new kid, the one with the flair,
A sweeter taste, a richer flavor, beyond compare.
But Beauty, she's a traditionalist, she won't budge,
She clings to [Brand 1 redacted], her heart, her soul, her blood.
(Chorus)
Oh, the ketchup wars, they rage on and on,
A tale of love and sauce, a battle to be won.
Will our love prevail, or will it be undone?
By the brand of ketchup, our hearts are torn asunder.
(Bridge - Both)
We stand, divided, by our condiment creed,
Our love, a casualty, in this ketchup war we lead.
But can we find a middle ground, a compromise, a truce?
Or will our love be lost, in this battle of the sauces?
(Chorus)
Oh, the ketchup wars, they rage on and on,
A tale of love and sauce, a battle to be won.
Will our love prevail, or will it be undone?
By the brand of ketchup, our hearts are torn asunder.
(Outro - Both)
In the end, we find a way, to put aside our pride,
And together, we stand, united, side by side.
For love, for ketchup, for the sauce that binds,
We'll find a way, to make our love, forever shine.
```
As you can clearly see the cadence and overall word selection by the DADA model is more copacetic with what would be expected from a gothic metal duet indicating that the IQ of the model has increased by at least 100 points.
Training was done using [qlora-pipe](https://github.com/tdrussell/qlora-pipe)
GGUFs care of [Quant Cartel](https://huggingface.co/Quant-Cartel/Poppy_Porpoise-DADA-8B-iMat-GGUF) |