File size: 4,772 Bytes
e4f0883 3b3083b e4f0883 3b3083b ac08f07 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 |
---
base_model:
- TheDrummer/Big-Tiger-Gemma-27B-v1
- migtissera/Tess-v2.5-Gemma-2-27B-alpha
- TheDrummer/Gemmasutra-Pro-27B-v1
library_name: transformers
tags:
- merge
license: apache-2.0
---
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>G2-MS-Nyxora-27b Data Card</title>
<link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
<style>
body, html {
height: 100%;
margin: 0;
padding: 0;
font-family: 'Quicksand', sans-serif;
background: linear-gradient(135deg, #0a1128 0%, #1c2541 100%);
color: #e0e1dd;
font-size: 16px;
}
.container {
width: 100%;
height: 100%;
padding: 20px;
margin: 0;
background-color: rgba(255, 255, 255, 0.05);
border-radius: 12px;
box-shadow: 0 4px 10px rgba(0, 0, 0, 0.3);
backdrop-filter: blur(10px);
border: 1px solid rgba(255, 255, 255, 0.1);
}
.header h1 {
font-size: 28px;
color: #4cc9f0;
margin: 0 0 20px 0;
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.3);
}
.update-section h2 {
font-size: 24px;
color: #7209b7;
}
.update-section p {
font-size: 16px;
line-height: 1.6;
color: #e0e1dd;
}
.info img {
width: 100%;
border-radius: 10px;
margin-bottom: 15px;
}
a {
color: #4cc9f0;
text-decoration: none;
}
a:hover {
color: #f72585;
}
.button {
display: inline-block;
background-color: #3a0ca3;
color: #e0e1dd;
padding: 10px 20px;
border-radius: 5px;
cursor: pointer;
text-decoration: none;
}
.button:hover {
background-color: #7209b7;
}
pre {
background-color: #1c2541;
padding: 10px;
border-radius: 5px;
overflow-x: auto;
}
code {
font-family: 'Courier New', monospace;
color: #e0e1dd;
}
.donation-section {
margin-top: 20px;
text-align: center;
}
.donation-section p {
margin-bottom: 10px;
}
</style>
</head>
<body>
<div class="container">
<div class="header">
<h1>G2-DA-Nyxora-27b-V2</h1>
</div>
<div class="info">
<img src="https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/rqcAEjzvLpQwu2Cg3g1hH.png" alt="Model Image">
<p>Now that the cute anime girl has your attention.</p>
<p><strong>Creator:</strong> <a href="https://huggingface.co/Steelskull" target="_blank">SteelSkull</a></p>
<h1>About G2-DA-Nyxora-27b-V2:</h1>
<pre><code><strong>Model Name Legend =</strong>
"G2 = Gemma 2"
"DA = Della"
"Nyxora = Tiger Base = cat = Nya"
"27b = its 27b"
"V2 = V2"</code></pre>
<p>This model is the second experimental foray into 27b models. Feedback is welcome for further improvements.</p>
<p>G2-DA-Nyxora-27b-V2 combines multiple models' strengths to provide a versatile assistant for various tasks, including general use, storytelling, and roleplay (ERP & RP). </p>
<p>The Model seems to have fixed alot of the prudish issues of the last model.</p>
<p>The new Exprimental merge method Della builds upon DARE, It uses adaptive pruning based on parameter magnitudes. DELLA first ranks parameters in each row of delta parameters and assigns drop probabilities inversely proportional to their magnitudes. This allows it to retain more important changes while reducing interference. After pruning, it rescales the remaining parameters similar to DARE.</p>
<h2>Quants:</h2>
<p>Will add as found or im notified of their creation (If you know of one create a discussion!)
<li><a href="https://huggingface.co/SteelQuants">SteelQuants</a>, My Personal Quants</li>
<p></p>
<h2>Config:</h2>
<pre><code>MODEL_NAME = "G2-DA-Nyxora-27b-V2"
yaml_config = """
base_model: TheDrummer/Big-Tiger-Gemma-27B-v1
merge_method: della
dtype: bfloat16
models:
- model: TheDrummer/Gemmasutra-Pro-27B-v1
- model: migtissera/Tess-v2.5-Gemma-2-27B-alpha
"""</code></pre>
<h4>Template:</h4>
<pre><code><start_of_turn>user
{{ if .System }}{{ .System }} {{ end }}{{ .Prompt }}<end_of_turn>
<start_of_turn>model
{{ .Response }}<end_of_turn></code></pre>
<p><strong>I've had a few people ask about donations so here's a link:</strong</p>
</div>
<div class="donation-section">
<a href="https://ko-fi.com/Y8Y0AO2XE" target="_blank">
<img height="36" style="border:0px;height:36px;" src="https://storage.ko-fi.com/cdn/kofi2.png?v=3" border="0" alt="Buy Me a Coffee at ko-fi.com" />
</a>
</div>
</div>
</body>
</html> |