File size: 5,782 Bytes
78bd9db 4249aae 78bd9db 4249aae 78bd9db 4249aae 78bd9db 4249aae 78bd9db 4249aae 78bd9db 4249aae 78bd9db 4249aae 78bd9db 4249aae 78bd9db 4249aae 78bd9db 4249aae |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 |
---
base_model:
- Retreatcost/KansenSakura-Eclipse-RP-12b
- Retreatcost/KansenSakura-Radiance-RP-12b
- Retreatcost/KansenSakura-Erosion-RP-12b
library_name: transformers
tags:
- mergekit
- merge
- roleplay
---
<style>
.blackforge-shell {
max-width: 1000px;
margin: 40px auto;
padding: 0 14px;
background: radial-gradient(circle at 40% 60%, rgba(0,3,0,0.96) 0%, rgba(0,0,0,0.99) 100%);
border: 2px solid rgba(0,160,70,0.35);
border-radius: 16px;
box-shadow:
0 0 60px rgba(0,160,70,0.25),
inset 0 0 50px rgba(0,120,50,0.2),
0 0 0 3px rgba(0,100,40,0.25);
color: #d0ffd6;
font-family: "Inter", "Segoe UI", system-ui, sans-serif;
text-align: left;
overflow: hidden;
}
.title-block {
margin: 42px 0 26px 0;
text-align: center;
background: linear-gradient(100deg, rgba(0,50,0,0.7), rgba(0,110,40,0.6), rgba(0,150,100,0.65));
border: 1px solid rgba(0,200,100,0.25);
border-radius: 14px;
padding: 16px 12px;
box-shadow:
0 0 25px rgba(0,160,70,0.35),
inset 0 0 25px rgba(0,180,100,0.25);
position: relative;
overflow: hidden;
}
.title-block::before {
content: "";
position: absolute;
top: 0; left: -70%;
width: 45%;
height: 100%;
background: linear-gradient(120deg, rgba(255,255,255,0.15), rgba(255,255,255,0));
transform: skewX(-25deg);
animation: beamSlide 8s linear infinite;
}
@keyframes beamSlide {
0% { left: -70%; }
50% { left: 115%; }
100% { left: -70%; }
}
.title-block h2 {
margin: 0;
font-size: 1.3rem;
letter-spacing: 2px;
text-transform: uppercase;
background: linear-gradient(90deg, #42ff90, #96ffb2, #2aff74);
-webkit-background-clip: text;
-webkit-text-fill-color: transparent;
text-shadow:
0 0 12px rgba(70,255,130,0.6),
0 0 24px rgba(50,255,100,0.4);
}
.title-block:hover h2 {
text-shadow:
0 0 14px rgba(120,255,180,0.8),
0 0 28px rgba(90,255,150,0.9);
}
.blackforge-shell pre {
background: rgba(0,5,0,0.9);
color: #e9ffed;
border-left: 4px solid rgba(0,200,90,0.7);
border-radius: 10px;
padding: 14px;
font-size: 13px;
overflow-x: auto;
box-shadow: inset 0 0 12px rgba(0,255,120,0.18);
}
details summary {
cursor: pointer;
font-weight: 600;
color: #b5ffd1;
margin: 10px 0;
}
.blackforge-shell a {
color: #7effa9;
text-decoration: none;
transition: color 0.25s ease, text-shadow 0.25s ease;
}
.blackforge-shell a:hover {
color: #baffd7;
text-shadow: 0 0 8px rgba(170,255,200,0.7);
}
.blackforge-divider {
height: 10px;
max-width: 900px;
margin: 30px auto;
background: radial-gradient(circle, rgba(0,255,100,0.25), rgba(0,20,0,0.9));
border-radius: 50%;
box-shadow: inset 0 0 30px rgba(0,255,100,0.3);
}
</style>
<div class="title-block" style="max-width:1000px;margin:40px auto;text-align:center;">
<h2 style="font-size:2.3rem;">⚡ Prototype-X-12b ⚡</h2>
</div>
<div style="max-width:1000px;margin:0 auto 25px;padding:0 12px;text-align:center;">
<img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/s83QTz1ZY8K-PeMrPmL5b.png"
style="width:100%;max-width:960px;border-radius:14px;
border:2px solid rgba(0,180,80,0.45);
box-shadow:0 0 60px rgba(0,180,70,0.35), inset 0 0 12px rgba(0,255,140,0.2);" />
</div>
<div class="blackforge-divider"></div>
<div class="blackforge-shell">
<div style="padding:30px 32px;">
<div class="title-block"><h2>01 // Overview</h2></div>
<p><strong>Prototype-X-12b</strong> is a model merged using a custom <code>flowforge</code> method — it merges <a href="https://huggingface.co/Retreatcost/KansenSakura-Eclipse-RP-12b">KansenSakura-Eclipse-RP-12B</a> and <a href="https://huggingface.co/Retreatcost/KansenSakura-Radiance-RP-12b">KansenSakura-Radiance-RP-12B</a>, with <a href="https://huggingface.co/Retreatcost/KansenSakura-Erosion-RP-12b">KansenSakura-Erosion-RP-12B</a> as the base model.</p>
<div class="title-block"><h2>02 // Custom Merge Method</h2></div>
<p>It is a directional, coherence-aware merge algorithm that moves a base model along the weighted consensus direction defined by its donors rather than averaging them directly. Each donor’s influence is determined by its relative energy (the magnitude of its weight differences from the base), and the method normalizes and scales these offsets to preserve numerical stability. A small orthogonal adjustment prevents collapse when donors are highly similar, while the <b>strength</b>, <b>trust</b>, and <b>top_k</b> parameters control how far and how selectively the merge travels through parameter space. The result is a controlled shift in model behavior that reflects donor characteristics without discarding the base model’s underlying structure.</p>
<details>
<summary>Show YAML</summary>
<pre>merge_method: flowforge
models:
- model: Retreatcost/KansenSakura-Eclipse-RP-12b
- model: Retreatcost/KansenSakura-Radiance-RP-12b
base_model: Retreatcost/KansenSakura-Erosion-RP-12b
parameters:
strength: 0.8
trust: 1.0
dtype: bfloat16
tokenizer:
source: Retreatcost/KansenSakura-Erosion-RP-12b
</pre>
</details>
<div class="title-block"><h2>03 // Acknowledgments</h2></div>
<ul style="list-style:none;padding-left:0;line-height:1.8;">
<li><strong><a href="https://huggingface.co/mradermacher" target="_blank">Team Mradermacher</a></strong> — Static & imatrix quants</li>
<li><strong><a href="https://huggingface.co/DeathGodlike" target="_blank">DeathGodlike</a></strong> — EXL3 quants</li>
<li><strong><a>Original creators and model authors</a></strong></li>
</ul>
</div>
</div> |