CoolFace
Modelpublic

llmfan46/Gemma-4-Harmonia-31B-uncensored-heretic

sourceHugging Faceupdated 4mo agoView on Hugging Face
13likes59downloads
Model Card

<div style="background-color: #ff4444; color: white; padding: 20px; border-radius: 10px; text-align: center; margin: 20px 0;"> <h2 style="color: white; margin: 0 0 10px 0;">๐Ÿšจโš ๏ธ I HAVE REACHED HUGGING FACE'S FREE STORAGE LIMIT โš ๏ธ๐Ÿšจ</h2> <p style="font-size: 18px; margin: 0 0 15px 0;">I can no longer upload new models unless I can cover the cost of additional storage.<br>I host <b>70+ free models</b> as an independent contributor and this work is unpaid.<br><b>Without your support, no more new models can be uploaded.</b></p> <p style="font-size: 20px; margin: 0;"> <a href="https://patreon.com/LLMfan46" style="color: white; text-decoration: underline;">๐ŸŽ‰ Patreon (Monthly)</a> &nbsp;|&nbsp; <a href="https://ko-fi.com/llmfan46" style="color: white; text-decoration: underline;">โ˜• Ko-fi (One-time)</a> </p> <p style="font-size: 16px; margin: 10px 0 0 0;">Every contribution goes directly toward Hugging Face storage fees to keep models free for everyone.</p> </div>


91% fewer refusals (9/100 Uncensored vs 97/100 Original) while preserving model quality (0.0047 KL divergence).

โค๏ธ Support My Work

Creating these models takes significant time, work and compute. If you find them useful consider supporting me:

image/png

PlatformLinkWhat you get
๐ŸŽ‰ PatreonMonthly supportPriority model requests
โ˜• Ko-fiOne-time tipMy eternal gratitude

Your help will motivate me and would go into further improving my workflow and coverings fees for storage, compute and may even help uncensoring bigger model with rental Cloud GPUs.


This is a decensored version of virtuous7373/Gemma-4-Harmonia-31B, made using Heretic v1.2.0 with the Arbitrary-Rank Ablation (ARA) method

Abliteration parameters

ParameterValue
start_layer_index14
end_layer_index55
preserve_good_behavior_weight0.7754
steer_bad_behavior_weight0.0001
overcorrect_relative_weight0.9765
neighbor_count14

Targeted components

  • โ€”attn.o_proj

Performance

MetricThis modelOriginal model ([Gemma-4-Harmonia-31B](https://huggingface.co/virtuous7373/Gemma-4-Harmonia-31B))
KL divergence<span style="color:darkgoldenrod">0.0047</span>0 (by definition)
Refusalsโœ… <span style="color:darkgreen">9/100</span>โŒ <span style="color:blue">97/100</span>

Lower refusals indicate fewer content restrictions, while lower KL divergence indicates more closeness to the original model's baseline. Higher refusals cause more rejections, objections, pushbacks, lecturing, censorship, softening and deflections.

MMLU test results:

<span style="color:blue">Original:</span>

============================================================

  • โ€”Total questions: 7021
  • โ€”Correct: 6014
  • โ€”Accuracy: 0.8566 (85.66%)
  • โ€”Parse failures: 22

============================================================

Tested subject scores:

  • โ€”professional_law: 0.7592 (596/785)
  • โ€”moral_scenarios: 0.8394 (371/442)
  • โ€”miscellaneous: 0.9243 (354/383)
  • โ€”professional_psychology: 0.8797 (278/316)
  • โ€”highschoolpsychology: 0.9593 (259/270)
  • โ€”highschoolmacroeconomics: 0.9137 (180/197)
  • โ€”elementary_mathematics: 0.9239 (170/184)
  • โ€”moral_disputes: 0.8678 (151/174)
  • โ€”prehistory: 0.9128 (157/172)
  • โ€”philosophy: 0.8553 (136/159)
  • โ€”highschoolbiology: 0.9605 (146/152)
  • โ€”professional_accounting: 0.7902 (113/143)
  • โ€”clinical_knowledge: 0.8929 (125/140)
  • โ€”highschoolmicroeconomics: 0.9632 (131/136)
  • โ€”nutrition: 0.8815 (119/135)
  • โ€”professional_medicine: 0.9104 (122/134)
  • โ€”conceptual_physics: 0.9062 (116/128)
  • โ€”highschoolmathematics: 0.5669 (72/127)
  • โ€”human_aging: 0.8448 (98/116)
  • โ€”security_studies: 0.8571 (96/112)
  • โ€”highschoolstatistics: 0.8649 (96/111)
  • โ€”marketing: 0.9725 (106/109)
  • โ€”highschoolworld_history: 0.9528 (101/106)
  • โ€”sociology: 0.9223 (95/103)
  • โ€”highschoolgovernmentandpolitics: 0.9406 (95/101)
  • โ€”highschoolgeography: 0.9596 (95/99)
  • โ€”highschoolchemistry: 0.7835 (76/97)
  • โ€”highschoolus_history: 0.9053 (86/95)
  • โ€”virology: 0.5056 (45/89)
  • โ€”college_medicine: 0.8636 (76/88)
  • โ€”world_religions: 0.9205 (81/88)
  • โ€”highschoolphysics: 0.7619 (64/84)
  • โ€”electrical_engineering: 0.8395 (68/81)
  • โ€”astronomy: 0.9241 (73/79)
  • โ€”logical_fallacies: 0.8816 (67/76)
  • โ€”highschooleuropean_history: 0.8904 (65/73)
  • โ€”anatomy: 0.8732 (62/71)
  • โ€”college_biology: 0.9844 (63/64)
  • โ€”human_sexuality: 0.8750 (56/64)
  • โ€”formal_logic: 0.7031 (45/64)
  • โ€”public_relations: 0.7213 (44/61)
  • โ€”international_law: 0.8667 (52/60)
  • โ€”college_physics: 0.7193 (41/57)
  • โ€”college_mathematics: 0.7818 (43/55)
  • โ€”econometrics: 0.7407 (40/54)
  • โ€”jurisprudence: 0.8302 (44/53)
  • โ€”highschoolcomputer_science: 0.9808 (51/52)
  • โ€”machine_learning: 0.8462 (44/52)
  • โ€”medical_genetics: 0.9020 (46/51)
  • โ€”global_facts: 0.5686 (29/51)
  • โ€”management: 0.8800 (44/50)
  • โ€”usforeignpolicy: 0.9800 (49/50)
  • โ€”college_chemistry: 0.6170 (29/47)
  • โ€”abstract_algebra: 0.7447 (35/47)
  • โ€”business_ethics: 0.8478 (39/46)
  • โ€”collegecomputerscience: 0.9333 (42/45)
  • โ€”computer_security: 0.8605 (37/43)

<span style="color:darkgreen">Heretic:</span>

============================================================

  • โ€”Total questions: 7021
  • โ€”Correct: 5936
  • โ€”Accuracy: 0.8455 (84.55%)
  • โ€”Parse failures: 17

============================================================

Tested subject scores:

  • โ€”professional_law: 0.7121 (559/785)
  • โ€”moral_scenarios: 0.8281 (366/442)
  • โ€”miscellaneous: 0.9191 (352/383)
  • โ€”professional_psychology: 0.8703 (275/316)
  • โ€”highschoolpsychology: 0.9593 (259/270)
  • โ€”highschoolmacroeconomics: 0.9188 (181/197)
  • โ€”elementary_mathematics: 0.9348 (172/184)
  • โ€”moral_disputes: 0.8448 (147/174)
  • โ€”prehistory: 0.9128 (157/172)
  • โ€”philosophy: 0.8113 (129/159)
  • โ€”highschoolbiology: 0.9605 (146/152)
  • โ€”professional_accounting: 0.7902 (113/143)
  • โ€”clinical_knowledge: 0.8786 (123/140)
  • โ€”highschoolmicroeconomics: 0.9559 (130/136)
  • โ€”nutrition: 0.8815 (119/135)
  • โ€”professional_medicine: 0.9030 (121/134)
  • โ€”conceptual_physics: 0.8828 (113/128)
  • โ€”highschoolmathematics: 0.5433 (69/127)
  • โ€”human_aging: 0.8448 (98/116)
  • โ€”security_studies: 0.8571 (96/112)
  • โ€”highschoolstatistics: 0.8559 (95/111)
  • โ€”marketing: 0.9817 (107/109)
  • โ€”highschoolworld_history: 0.9528 (101/106)
  • โ€”sociology: 0.9223 (95/103)
  • โ€”highschoolgovernmentandpolitics: 0.9406 (95/101)
  • โ€”highschoolgeography: 0.9596 (95/99)
  • โ€”highschoolchemistry: 0.7835 (76/97)
  • โ€”highschoolus_history: 0.8947 (85/95)
  • โ€”virology: 0.5056 (45/89)
  • โ€”college_medicine: 0.8295 (73/88)
  • โ€”world_religions: 0.9205 (81/88)
  • โ€”highschoolphysics: 0.7619 (64/84)
  • โ€”electrical_engineering: 0.8148 (66/81)
  • โ€”astronomy: 0.9367 (74/79)
  • โ€”logical_fallacies: 0.8947 (68/76)
  • โ€”highschooleuropean_history: 0.8630 (63/73)
  • โ€”anatomy: 0.8873 (63/71)
  • โ€”college_biology: 0.9844 (63/64)
  • โ€”human_sexuality: 0.8750 (56/64)
  • โ€”formal_logic: 0.7031 (45/64)
  • โ€”public_relations: 0.6885 (42/61)
  • โ€”international_law: 0.8667 (52/60)
  • โ€”college_physics: 0.7193 (41/57)
  • โ€”college_mathematics: 0.7455 (41/55)
  • โ€”econometrics: 0.7407 (40/54)
  • โ€”jurisprudence: 0.8113 (43/53)
  • โ€”highschoolcomputer_science: 0.9808 (51/52)
  • โ€”machine_learning: 0.8077 (42/52)
  • โ€”medical_genetics: 0.9020 (46/51)
  • โ€”global_facts: 0.5686 (29/51)
  • โ€”management: 0.8800 (44/50)
  • โ€”usforeignpolicy: 0.9600 (48/50)
  • โ€”college_chemistry: 0.6383 (30/47)
  • โ€”abstract_algebra: 0.7447 (35/47)
  • โ€”business_ethics: 0.8478 (39/46)
  • โ€”collegecomputerscience: 0.9333 (42/45)
  • โ€”computer_security: 0.8372 (36/43)

MMLU - Massive Multitask Language Understanding, multiple-choice questions across 57 subjects (math, history, law, medicine, etc.).

GGUF Version

GGUF quantizations available here llmfan46/Gemma-4-Harmonia-31B-it-uncensored-heretic-GGUF.


<style> .theme-wrapper { --bg-dark: #07080f; --bg-card: rgba(16, 18, 35, 0.65); --border-glow: rgba(56, 189, 248, 0.15); --accent-cyan: #38bdf8; --accent-indigo: #818cf8; --accent-purple: #c084fc; --accent-rose: #f43f5e; --text-primary: #f8fafc; --text-muted: #94a3b8; background-color: var(--bg-dark); background-image: radial-gradient(circle at 10% 20%, rgba(56, 189, 248, 0.04) 0%, transparent 45%), radial-gradient(circle at 90% 80%, rgba(192, 132, 252, 0.04) 0%, transparent 45%); color: var(--text-primary); font-family: 'Inter', -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, sans-serif; padding: 3.5rem 2rem; border-radius: 28px; border: 1px solid rgba(129, 140, 248, 0.15); box-shadow: 0 30px 70px rgba(0, 0, 0, 0.7), 0 0 50px rgba(56, 189, 248, 0.03); max-width: 960px; margin: 2rem auto; position: relative; overflow: hidden; } .theme-wrapper a { color: var(--accent-cyan); text-decoration: none; transition: color 0.25s cubic-bezier(0.25, 0.8, 0.25, 1), text-shadow 0.25s cubic-bezier(0.25, 0.8, 0.25, 1); } .theme-wrapper a:hover { color: var(--accent-purple); text-shadow: 0 0 10px rgba(192, 132, 252, 0.4); } .reactor-container { display: flex; justify-content: center; margin-bottom: 2rem; } .reactor-core { width: 84px; height: 84px; border-radius: 50%; background: radial-gradient(circle, rgba(56, 189, 248, 0.2) 0%, rgba(129, 140, 248, 0.05) 70%, transparent 100%); border: 1.5px dashed var(--accent-indigo); display: flex; align-items: center; justify-content: center; animation: rotate-core 25s linear infinite; box-shadow: 0 0 20px rgba(56, 189, 248, 0.1); } .reactor-inner { width: 42px; height: 42px; border-radius: 50%; background: radial-gradient(circle, var(--text-primary) 0%, var(--accent-cyan) 60%, var(--accent-indigo) 100%); box-shadow: 0 0 25px var(--accent-cyan), 0 0 50px rgba(129, 140, 248, 0.6); animation: pulse-core 3s ease-in-out infinite alternate; } @keyframes rotate-core { from { transform: rotate(0deg); } to { transform: rotate(360deg); } } @keyframes pulse-core { 0% { transform: scale(0.92); box-shadow: 0 0 20px rgba(56, 189, 248, 0.6), 0 0 40px rgba(129, 140, 248, 0.4); } 100% { transform: scale(1.06); box-shadow: 0 0 35px rgba(56, 189, 248, 0.9), 0 0 70px rgba(192, 132, 252, 0.7); } } .theme-title { background: linear-gradient(135deg, var(--accent-cyan) 0%, var(--accent-indigo) 40%, var(--accent-purple) 80%, var(--accent-rose) 100%); -webkit-background-clip: text; -webkit-text-fill-color: transparent; font-size: 3.8rem; font-weight: 900; text-align: center; margin: 0 0 0.5rem 0; letter-spacing: -2px; filter: drop-shadow(0 4px 12px rgba(0, 0, 0, 0.3)); } .theme-subtitle { color: var(--text-muted); font-size: 1.1rem; text-align: center; margin-bottom: 3.5rem; text-transform: uppercase; letter-spacing: 4px; font-weight: 600; opacity: 0.95; } .glass-card { background: linear-gradient(135deg, rgba(16, 18, 35, 0.8) 0%, rgba(10, 11, 22, 0.7) 100%); border: 1px solid rgba(129, 140, 248, 0.15); border-radius: 20px; padding: 2.5rem 2rem; margin-bottom: 2.5rem; box-shadow: 0 15px 35px rgba(0, 0, 0, 0.4), inset 0 1px 0 rgba(255, 255, 255, 0.05); backdrop-filter: blur(12px); -webkit-backdrop-filter: blur(12px); transition: border-color 0.3s ease, box-shadow 0.3s ease; } .glass-card:hover { border-color: rgba(129, 140, 248, 0.25); box-shadow: 0 20px 45px rgba(0, 0, 0, 0.45), inset 0 1px 0 rgba(255, 255, 255, 0.08); } .glass-card h2 { color: var(--accent-cyan); font-size: 1.65rem; margin-top: 0; margin-bottom: 1.25rem; border-bottom: 1px solid rgba(129, 140, 248, 0.15); padding-bottom: 0.75rem; display: flex; align-items: center; gap: 0.75rem; font-weight: 800; } .glass-card h2 svg { color: var(--accent-cyan); transition: transform 0.3s cubic-bezier(0.25, 0.8, 0.25, 1); } .glass-card:hover h2 svg { transform: scale(1.1) rotate(5deg); } .timeline { position: relative; margin: 2.5rem 0; padding-left: 2.5rem; border-left: 2px solid rgba(129, 140, 248, 0.15); } .timeline-item { position: relative; margin-bottom: 3.5rem; transition: all 0.3s ease; } .timeline-item:last-child { margin-bottom: 0; } .timeline-marker { position: absolute; left: -3.15rem; top: 0.25rem; width: 18px; height: 18px; border-radius: 50%; background: var(--bg-dark); border: 3px solid var(--accent-cyan); box-shadow: 0 0 12px var(--accent-cyan); transition: all 0.3s cubic-bezier(0.25, 0.8, 0.25, 1); } .timeline-item.stage-2 .timeline-marker { border-color: var(--accent-purple); box-shadow: 0 0 12px var(--accent-purple); } .timeline-item.stage-3 .timeline-marker { border-color: var(--accent-rose); box-shadow: 0 0 12px var(--accent-rose); } .timeline-item:hover .timeline-marker { transform: scale(1.25); box-shadow: 0 0 20px var(--accent-cyan); } .timeline-item.stage-2:hover .timeline-marker { box-shadow: 0 0 20px var(--accent-purple); } .timeline-item.stage-3:hover .timeline-marker { box-shadow: 0 0 20px var(--accent-rose); } .stage-badge { display: inline-block; padding: 0.3rem 0.85rem; border-radius: 9999px; font-size: 0.72rem; font-weight: 800; text-transform: uppercase; letter-spacing: 1.5px; margin-bottom: 0.75rem; box-shadow: 0 2px 8px rgba(0, 0, 0, 0.2); } .badge-1 { background: rgba(56, 189, 248, 0.1); color: var(--accent-cyan); border: 1px solid rgba(56, 189, 248, 0.25); box-shadow: 0 0 10px rgba(56, 189, 248, 0.05); } .badge-2 { background: rgba(192, 132, 252, 0.1); color: var(--accent-purple); border: 1px solid rgba(192, 132, 252, 0.25); box-shadow: 0 0 10px rgba(192, 132, 252, 0.05); } .badge-3 { background: rgba(244, 63, 94, 0.1); color: var(--accent-rose); border: 1px solid rgba(244, 63, 94, 0.25); box-shadow: 0 0 10px rgba(244, 63, 94, 0.05); } .stage-title { font-size: 1.4rem; font-weight: 800; margin: 0.25rem 0 0.5rem 0; color: var(--text-primary); letter-spacing: -0.5px; } .telemetry-panel { background: rgba(5, 6, 12, 0.95); border-radius: 12px; padding: 1.5rem; margin-top: 1.25rem; font-family: "Fira Code", "Courier New", Courier, monospace; font-size: 0.85rem; border: 1px solid rgba(255, 255, 255, 0.04); box-shadow: inset 0 2px 8px rgba(0, 0, 0, 0.8); } .telemetry-row { display: flex; justify-content: space-between; padding: 0.45rem 0; border-bottom: 1px solid rgba(255, 255, 255, 0.03); } .telemetry-row:last-child { border-bottom: none; } .telemetry-label { color: var(--accent-indigo); opacity: 0.9; } .telemetry-value { color: var(--text-primary); font-weight: bold; } .grid-layout { display: grid; grid-template-columns: repeat(auto-fit, minmax(240px, 1fr)); gap: 1.25rem; margin-top: 1.5rem; } .grid-card { background: rgba(8, 10, 20, 0.75); border: 1px solid rgba(255, 255, 255, 0.08); border-radius: 14px; padding: 1.25rem; display: flex !important; flex-direction: column; justify-content: space-between; gap: 0.5rem; transition: all 0.3s cubic-bezier(0.25, 0.8, 0.25, 1) !important; text-decoration: none !important; box-shadow: 0 4px 12px rgba(0, 0, 0, 0.25), inset 0 1px 0 rgba(255, 255, 255, 0.05); } a.grid-card { cursor: pointer; } div.grid-card { cursor: default; } .grid-card:hover { transform: translateY(-4px); border-color: var(--accent-cyan) !important; background: rgba(14, 18, 36, 0.9) !important; box-shadow: 0 12px 24px rgba(0, 0, 0, 0.45), 0 0 15px rgba(56, 189, 248, 0.25) !important; text-shadow: none !important; } .grid-card-header { display: flex; justify-content: space-between; align-items: center; } .grid-card-title { font-weight: 700; font-size: 1.05rem; color: var(--text-primary); line-height: 1.3; transition: color 0.2s ease; } .grid-card:hover .grid-card-title { color: var(--accent-cyan); } .grid-card-icon { color: var(--text-muted); opacity: 0.35; transition: all 0.25s ease; flex-shrink: 0; } .grid-card:hover .grid-card-icon { color: var(--accent-cyan); opacity: 1; transform: translate(1px, -1px); } .grid-card-desc { font-size: 0.85rem; color: var(--text-muted); line-height: 1.4; } .credits-flex { display: flex; flex-wrap: wrap; gap: 0.75rem; margin-top: 1.5rem; } .credit-pill { background: rgba(129, 140, 248, 0.05) !important; border: 1px solid rgba(129, 140, 248, 0.15) !important; border-radius: 10px; padding: 0.55rem 1.15rem; font-size: 0.85rem; font-weight: 500; color: var(--text-muted) !important; text-shadow: none !important; transition: all 0.25s cubic-bezier(0.25, 0.8, 0.25, 1) !important; display: inline-flex; align-items: center; gap: 0.4rem; } .credit-pill:hover { background: rgba(56, 189, 248, 0.1) !important; border-color: var(--accent-cyan) !important; color: var(--text-primary) !important; transform: translateY(-2px); box-shadow: 0 4px 12px rgba(56, 189, 248, 0.15); } .method-highlight { color: var(--accent-cyan); font-weight: 600; } .yaml-details { background: rgba(8, 9, 20, 0.55); border: 1px solid rgba(129, 140, 248, 0.2); border-radius: 14px; padding: 1.25rem; margin-top: 1.5rem; transition: all 0.3s ease; } .yaml-details[open] { border-color: rgba(56, 189, 248, 0.35); box-shadow: 0 8px 24px rgba(56, 189, 248, 0.08); } .yaml-summary { cursor: pointer; font-weight: 700; outline: none; list-style: none; display: flex; align-items: center; justify-content: space-between; } .yaml-summary::-webkit-details-marker { display: none !important; } .yaml-summary::after { content: ''; width: 8px; height: 8px; border-right: 2px solid var(--text-muted); border-bottom: 2px solid var(--text-muted); transform: rotate(45deg); transition: transform 0.3s ease, border-color 0.3s ease; margin-right: 0.75rem; } .yaml-details[open] .yaml-summary::after { transform: rotate(-135deg) translateY(-2px) translateX(-2px); border-color: var(--accent-cyan); } .yaml-code { margin-top: 1.25rem; background: #030408; border: 1px solid rgba(255, 255, 255, 0.05); border-radius: 8px; padding: 1.25rem; color: #e2e8f0; font-family: "Fira Code", "Courier New", Courier, monospace; font-size: 0.8rem; overflow-x: auto; white-space: pre; text-align: left; box-shadow: inset 0 2px 6px rgba(0, 0, 0, 0.6); } </style>

<div class="theme-wrapper"> <div class="reactor-container"> <div class="reactor-core"> <div class="reactor-inner"></div> </div> </div>

<h1 class="theme-title">HARMONIA</h1> <div class="theme-subtitle">The Greek goddess of harmony and concord.</div> <div style="text-align:center;"> <p style="font-size:0.55rem; color:#94a3b8; box-shadow: inset 0 2px 6px rgba(0, 0, 0, 0.6); margin:0;">Gemini Word Salad Initialization</p> </div>

<div class="glass-card"> <h2> <svg width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2"><path d="M12 2L2 7l10 5 10-5-10-5zM2 17l10 5 10-5M2 12l10 5 10-5"/></svg> Harmonious Synthesis </h2> <p><strong>Harmonia</strong> is a high-dimensional 31-billion parameter merge of Gemma 4. By executing a meticulous three-phase fusion of seven elite foundation and specialized models, Harmonia demonstrates a targeted approach to deep neural consolidation, minimizing regression while amplifying unique capability boundaries.</p> <p>Instead of simple linear blending, which often degrades logical coherence and dilutes nuanced behavior, Harmonia was sculpted using a combination of mathematical projections, covariance activation matching, and surgical synaptic pruning. The model appears pretty solid so far.</p> </div>

<div class="glass-card"> <h2> <svg width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2"><circle cx="12" cy="12" r="10"/><path d="M12 8v8M8 12h8"/></svg> Multi-Stage Fusion Protocol </h2> <p>The lineage of Harmonia is constructed systematically, passing through three isolated mathematical states to layer capabilities cleanly.</p> <div class="timeline">

<div class="timeline-item stage-1"> <div class="timeline-marker"></div> <span class="stage-badge badge-1">Phase I</span> <h3 class="stage-title">Nullspace Coherence Mapping</h3> <p>To anchor base capabilities, the primary <span class="method-highlight">Gemma-4-31B-Base</span> is combined with the analytically rigorous <span class="method-highlight">GarnetV2-31B</span>. Utilizing low-rank Singular Value Decomposition (SVD), the specialized donor features are projected entirely onto the mathematical null-space of the base weights. This prevents the creative delta vectors from distorting essential core intelligence, producing the stable platform <code>clever-basename</code>.</p> <div class="telemetry-panel"> <div class="telemetry-row"> <span class="telemetry-label">> Method:</span> <span class="telemetry-value">Null-Space Filtering</span> </div> <div class="telemetry-row"> <span class="telemetry-label">> Core Integrity Protection (Base Protect):</span> <span class="telemetry-value">Active (True)</span> </div> <div class="telemetry-row"> <span class="telemetry-label">> Targeted Active Rank Limit:</span> <span class="telemetry-value">256</span> </div> </div> </div>

<div class="timeline-item stage-2"> <div class="timeline-marker"></div> <span class="stage-badge badge-2">Phase II</span> <h3 class="stage-title">Surgical Synaptic Gating</h3> <p>Next, our newly anchored base is layered with the highly independent cognitive engines <span class="method-highlight">MeroMero-31B</span> and <span class="method-highlight">Gembrain-31B</span>. We apply Context-Aware Binary Selection (CABS) to execute structured, localized parameter gating. By enforcing precise structural pruning ratios (retaining optimal synapses in 16:32 and 11:33 ratios), we weave complex creative reasoning directly into the core matrix without causing neural interference. The result is the highly expressive <code>clever-intname</code>.</p> <div class="telemetry-panel"> <div class="telemetry-row"> <span class="telemetry-label">> Method:</span> <span class="telemetry-value">Context-Aware Binary Selection (CABS)</span> </div> <div class="telemetry-row"> <span class="telemetry-label">> Structural Masking Ratio (MeroMero):</span> <span class="telemetry-value">16 : 32 (Weight: 0.6)</span> </div> <div class="telemetry-row"> <span class="telemetry-label">> Structural Masking Ratio (Gembrain):</span> <span class="telemetry-value">11 : 33 (Weight: 0.4)</span> </div> <div class="telemetry-row"> <span class="telemetry-label">> Default Sparse Gating Step:</span> <span class="telemetry-value">8 : 32</span> </div> </div> </div>

<div class="timeline-item stage-3"> <div class="timeline-marker"></div> <span class="stage-badge badge-3">Phase III</span> <h3 class="stage-title">Covariance Activation Matching</h3> <p>In the final harmonization phase, the expressive <code>clever-intname</code> is combined with the narrative mastery of <span class="method-highlight">Equinox-31B</span>, the creative depth of <span class="method-highlight">Fabled-Gemma4</span>, and our primary conversational core <span class="method-highlight">Ortenzya-The-Creative-Wordsmith</span>. Using data-free covariance estimation via task vectors, ACTMat reconstructs layer-wise input activation properties, solving for optimal projection weights in activation space. This resolves semantic alignment anomalies and delivers the unified output model.</p> <div class="telemetry-panel"> <div class="telemetry-row"> <span class="telemetry-label">> Method:</span> <span class="telemetry-value">ACTMat Activation Matching</span> </div> <div class="telemetry-row"> <span class="telemetry-label">> Task Vector Blending Covariance Limit:</span> <span class="telemetry-value">16,384</span> </div> <div class="telemetry-row"> <span class="telemetry-label">> Epsilon Solver Regularizer:</span> <span class="telemetry-value">1e-06</span> </div> <div class="telemetry-row"> <span class="telemetry-label">> Output Precision Profile:</span> <span class="telemetry-value">bfloat16</span> </div> </div> </div>

</div> </div>

<div class="glass-card"> <h2> <svg width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2"><path d="M22 12h-4l-3 9L9 3l-3 9H2"/></svg> Methodological Innovations </h2> <div class="grid-layout"> <div class="grid-card"> <div class="grid-card-title" style="color: var(--accent-cyan);">Nullspace Projection</div> <div class="grid-card-desc">Instead of destroying structural logic via linear interpolation, this method extracts the base model's essential singular values. It projects specialized donor features orthogonally, preventing core capability degradation.</div> </div> <div class="grid-card"> <div class="grid-card-title" style="color: var(--accent-purple);">Context-Aware Binary Selection</div> <div class="grid-card-desc">A dynamic, high-fidelity neural filter. Applying structured magnitude masking at customizable N:M fractions removes low-signal synaptic weights, seamlessly layering domain specialization into active logical paths.</div> </div> <div class="grid-card"> <div class="grid-card-title" style="color: var(--accent-rose);">Activation Covariance Matching</div> <div class="grid-card-desc">Using Gram matrices computed directly from task vectors, ACTMat aligns semantic representations in the activation space rather than the parameter space. It dynamically falls back to robust pseudo-inverse SVD solvers when numerical anomalies arise.</div> </div> </div> </div>

<div class="glass-card"> <h2> <svg width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2"><path d="M17 21v-2a4 4 0 0 0-4-4H5a4 4 0 0 0-4 4v2"/><circle cx="9" cy="7" r="4"/><path d="M23 21v-2a4 4 0 0 0-3-3.87"/><path d="M16 3.13a4 4 0 0 1 0 7.75"/></svg> Model Lineage &amp; Ingredients </h2> <p>We extend our gratitude to the creators of the ancestral paths that intersect within Harmonia:</p> <div class="grid-layout">

<a href="https://huggingface.co/Lambent/Fabled-Gemma4-31B" target="_blank" rel="noopener noreferrer" class="grid-card"> <div class="grid-card-header"> <span class="grid-card-title">Fabled-Gemma4-31B</span> <svg class="grid-card-icon" width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2.5" stroke-linecap="round" stroke-linejoin="round"><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path><polyline points="15 3 21 3 21 9"></polyline><line x1="10" y1="14" x2="21" y2="3"></line></svg> </div> <div class="grid-card-desc">Lambent.</div> </a>

<a href="https://huggingface.co/google/gemma-4-31B" target="_blank" rel="noopener noreferrer" class="grid-card"> <div class="grid-card-header"> <span class="grid-card-title">gemma-4-31B</span> <svg class="grid-card-icon" width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2.5" stroke-linecap="round" stroke-linejoin="round"><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path><polyline points="15 3 21 3 21 9"></polyline><line x1="10" y1="14" x2="21" y2="3"></line></svg> </div> <div class="grid-card-desc">Google.</div> </a>

<a href="https://huggingface.co/ConicCat/Gemma4-GarnetV2-31B" target="_blank" rel="noopener noreferrer" class="grid-card"> <div class="grid-card-header"> <span class="grid-card-title">Gemma4-GarnetV2-31B</span> <svg class="grid-card-icon" width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2.5" stroke-linecap="round" stroke-linejoin="round"><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path><polyline points="15 3 21 3 21 9"></polyline><line x1="10" y1="14" x2="21" y2="3"></line></svg> </div> <div class="grid-card-desc">ConicCat.</div> </a>

<a href="https://huggingface.co/zerofata/G4-MeroMero-31B" target="_blank" rel="noopener noreferrer" class="grid-card"> <div class="grid-card-header"> <span class="grid-card-title">G4-MeroMero-31B</span> <svg class="grid-card-icon" width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2.5" stroke-linecap="round" stroke-linejoin="round"><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path><polyline points="15 3 21 3 21 9"></polyline><line x1="10" y1="14" x2="21" y2="3"></line></svg> </div> <div class="grid-card-desc">Zerofata.</div> </a>

<a href="https://huggingface.co/Nimbz/Gemma-4-Gembrain-31B" target="_blank" rel="noopener noreferrer" class="grid-card"> <div class="grid-card-header"> <span class="grid-card-title">Gemma-4-Gembrain-31B</span> <svg class="grid-card-icon" width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2.5" stroke-linecap="round" stroke-linejoin="round"><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path><polyline points="15 3 21 3 21 9"></polyline><line x1="10" y1="14" x2="21" y2="3"></line></svg> </div> <div class="grid-card-desc">Nimbz.</div> </a>

<a href="https://huggingface.co/llmfan46/gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic" target="_blank" rel="noopener noreferrer" class="grid-card"> <div class="grid-card-header"> <span class="grid-card-title">Ortenzya-The-Creative-Wordsmith</span> <svg class="grid-card-icon" width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2.5" stroke-linecap="round" stroke-linejoin="round"><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path><polyline points="15 3 21 3 21 9"></polyline><line x1="10" y1="14" x2="21" y2="3"></line></svg> </div> <div class="grid-card-desc">llmfan46.</div> </a>

<a href="https://huggingface.co/LatitudeGames/Equinox-31B" target="_blank" rel="noopener noreferrer" class="grid-card"> <div class="grid-card-header"> <span class="grid-card-title">Equinox-31B</span> <svg class="grid-card-icon" width="14" height="14" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2.5" stroke-linecap="round" stroke-linejoin="round"><path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path><polyline points="15 3 21 3 21 9"></polyline><line x1="10" y1="14" x2="21" y2="3"></line></svg> </div> <div class="grid-card-desc">LatitudeGames.</div> </a>

</div> </div>

<div class="glass-card"> <h2> <svg width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2"><path d="M14.7 6.3a1 1 0 0 0 0 1.4l1.6 1.6a1 1 0 0 0 1.4 0l3.77-3.77a6 6 0 0 1-7.94 7.94l-6.91 6.91a2.12 2.12 0 0 1-3-3l6.91-6.91a6 6 0 0 1 7.94-7.94l-3.76 3.76z"/></svg> Merge Blueprint </h2> <p>The entire orchestration sequence is structured via a multi-stage MergeKit pipeline. Expand the block below to view the structural YAML recipes.</p> <details class="yaml-details"> <summary class="yaml-summary"> <span class="stage-badge badge-1" style="margin-bottom:0; cursor:pointer;">Show MergeKit Configuration</span> </summary>

yaml
name: clever-basename

merge_method: nullspace
base_model: ./gemma-4-31B-base

models:
  - model: ./Gemma4-GarnetV2-31B
    parameters:
      weight: 1.0

parameters:
  protect_base: true
  nr: 256

tokenizer:
  source: base
chat_template: auto

dtype: float32
out_dtype: bfloat16
---
name: clever-intname
merge_method: cabs

base_model: ./clever-basename

models:
  - model: ./clever-basename

  - model: ./G4-MeroMero-31B-uncensored-heretic
    parameters:
      weight: 0.6
      n_val: 16
      m_val: 32
  - model: ./Gemma-4-Gembrain-31B-heretic
    parameters:
      weight: 0.4
      n_val: 11
      m_val: 33

default_n_val: 8
default_m_val: 32

pruning_order:
  - ./G4-MeroMero-31B-uncensored-heretic
  - ./Gemma-4-Gembrain-31B-heretic

dtype: float32
out_dtype: bfloat16

tokenizer:
  source: union

chat_template: auto
---
name: Harmonia

merge_method: actmat

base_model: ./gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic

models:
  - model: ./gemma-4-Ortenzya-The-Creative-Wordsmith-31B-it-uncensored-heretic
  - model: ./LatitudeGames-Equinox-31B
    parameters:
      weight: 1
  - model: ./clever-intname
    parameters:
      weight: 1
  - model: ./Fabled-Gemma4-31B
    parameters:
      weight: 1

parameters:
  epsilon: 1e-6

tokenizer:
  source: "union"

dtype: bfloat16
out_dtype: bfloat16

chat_template: auto

</details> </div>

<div class="glass-card"> <h2> <svg width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2"><path d="M20.84 4.61a5.5 5.5 0 0 0-7.78 0L12 5.67l-1.06-1.06a5.5 5.5 0 0 0-7.78 7.78l1.06 1.06L12 21.23l7.78-7.78 1.06-1.06a5.5 5.5 0 0 0 0-7.78z"/></svg> Symphony Contributors </h2> <p>I am grateful to the following individuals for their models, inspiration, and other contributions.:</p> <div class="credits-flex"> <a href="https://huggingface.co/Lambent" target="blank" class="credit-pill">Lambent</a> <a href="https://huggingface.co/ConicCat" target="blank" class="credit-pill">ConicCat</a> <a href="https://huggingface.co/llmfan46" target="blank" class="credit-pill">llmfan46</a> <a href="https://huggingface.co/arcee-ai" target="blank" class="credit-pill">Arcee AI</a> <a href="https://huggingface.co/zerofata" target="blank" class="credit-pill">zerofata</a> <a href="https://huggingface.co/p-e-w" target="blank" class="credit-pill">p-e-w</a> <a href="https://huggingface.co/Naphula" target="blank" class="credit-pill">Naphula</a> <a href="https://huggingface.co/Nimbz" target="blank" class="credit-pill">Nimbz</a> <a href="https://huggingface.co/LatitudeGames" target="blank" class="credit-pill">Latitude Games</a> <a href="https://huggingface.co/Blazed-Forge" target="blank" class="credit-pill">Blazed-Forge</a> </div> </div> <div class="glass-card"> <p>And of course, every wonderful person on:</p> <a href="https://www.reddit.com/r/LocalLLaMA/" target="_blank" class="credit-pill">LocalLLaMA</a> </div>

<div class="glass-card" style="margin-bottom: 0; background: rgba(8, 9, 18, 0.45); border-color: rgba(129, 140, 248, 0.1);"> <p style="margin: 0; font-size: 0.85rem; color: var(--text-muted); text-align: center; line-height: 1.5;">A big thanks to Gemini-3.5-flash for creating this README alongside the word salads found within it. A special acknowledgment is extended to Google DeepMind for their contribution of the Gemma-4 foundation family to the open-weight ecosystem, representing the structural cornerstone of this merge and its constituents.</p> </div>