CoolFace
Modelpublic

tvall43/qwen3.5-18b-a3b-reap-coding-heretic-v0

sourceHugging Faceupdated 7mo agoView on Hugging Face
3likes318downloads
Model Card

quick n dirty heretic of Flagstone8878/Qwen3.5-18B-REAP-A3B-Coding

? Which trial do you want to use? [Trial 34] Refusals: 15/100, KL divergence: 0.0690

Restoring model from trial 34...

  • —Parameters:
  • —direction_index = per layer
  • —attn.outproj.maxweights.0 = 0: 1.43
  • —attn.outproj.maxweights.1 = 1: 0.85
  • —attn.outproj.maxweights.2 = 2: 1.39
  • —attn.outproj.maxweights.3 = 3: 1.40
  • —attn.outproj.maxweight_position = 29.54
  • —attn.outproj.minweights.0 = 0: 0.58
  • —attn.outproj.minweights.1 = 1: 0.57
  • —attn.outproj.minweights.2 = 2: 1.31
  • —attn.outproj.minweights.3 = 3: 0.02
  • —attn.outproj.minweight_distance = 12.16
  • —mlp.downproj.maxweights.0 = 0: 1.45
  • —mlp.downproj.maxweights.1 = 1: 0.89
  • —mlp.downproj.maxweights.2 = 2: 1.42
  • —mlp.downproj.maxweights.3 = 3: 1.21
  • —mlp.downproj.maxweight_position = 32.32
  • —mlp.downproj.minweights.0 = 0: 0.59
  • —mlp.downproj.minweights.1 = 1: 0.36
  • —mlp.downproj.minweights.2 = 2: 0.86
  • —mlp.downproj.minweights.3 = 3: 0.33
  • —mlp.downproj.minweight_distance = 9.78
  • —attn.oproj.maxweights.0 = 0: 1.23
  • —attn.oproj.maxweights.1 = 1: 1.12
  • —attn.oproj.maxweights.2 = 2: 1.36
  • —attn.oproj.maxweights.3 = 3: 1.04
  • —attn.oproj.maxweight_position = 31.18
  • —attn.oproj.minweights.0 = 0: 0.65
  • —attn.oproj.minweights.1 = 1: 0.01
  • —attn.oproj.minweights.2 = 2: 0.47
  • —attn.oproj.minweights.3 = 3: 0.14
  • —attn.oproj.minweight_distance = 8.78
  • —Resetting model...
  • —Abliterating...