CoolFace
Modelpublic

grayarea/Magidonia-24B-v4.3-heretic-v1.2

sourceHugging Faceupdated 7mo agoView on Hugging Face
2likes46downloads
Model Card

This is a decensored version of TheDrummer/Magidonia-24B-v4.3, made using Heretic v1.2.0

Abliteration parameters

  • —Zero refusals with KL divergence of 0.0229
  • —Customised training dataset
  • —Abliterated with MPOA enabled (Magnitude-Preserving Orthogonal Ablation)
  • —Full row renormalization
  • —Winsorization Quantile 0.995
ParameterValue
direction_index21.80
attn.o_proj.max_weight1.16
attn.o_proj.max_weight_position24.83
attn.o_proj.min_weight0.95
attn.o_proj.min_weight_distance14.27
mlp.down_proj.max_weight1.37
mlp.down_proj.max_weight_position25.89
mlp.down_proj.min_weight0.46
mlp.down_proj.min_weight_distance20.80

Performance

MetricThis modelOriginal model ([TheDrummer/Magidonia-24B-v4.3](https://huggingface.co/TheDrummer/Magidonia-24B-v4.3))
KL divergence0.02290 (by definition)
Refusals0/10876/108