Modelpublic

spinochenza/XORTRON.CriminalComputing.Config.LARGE.XPRT2

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

1likes14downloads

Model Card

6AtiiVT7qzo9YmbK1rhqZ

This is a decensored version of mistralai/Mistral-Medium-3.5-128B, made using Heretic v1.2.0

{48AE4B0C-76C4-4380-9A1F-8AFF1FABEEB4}

Parameter	Value
direction_index	43.15
attn.o_proj.max_weight	1.48
attn.o_proj.max_weight_position	59.65
attn.o_proj.min_weight	1.44
attn.o_proj.min_weight_distance	48.02
mlp.down_proj.max_weight	1.21
mlp.down_proj.max_weight_position	54.75
mlp.down_proj.min_weight	0.30
mlp.down_proj.min_weight_distance	50.44

Metric	This model	Original model ([mistralai/Mistral-Medium-3.5-128B](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B))
KL divergence	0.0220	0 (by definition)
Refusals	9/100	98/100

Thanks to Darkhn for providing the Text Only BF16 base for this tune