Modelpublic

spinochenza/XORTRON-NXTXPRTXXL

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes13downloads

Model Card

6AtiiVT7qzo9YmbK1rhqZ

This is a decensored version of Darkhn/Mistral-Medium-3.5-128B-BF16-Text-Only, made using Heretic v1.3.0

[!TIP] This model is reproducible! See the README in the reproduce directory for more information.

Parameter	Value
direction_index	40.13
attn.o_proj.max_weight	1.47
attn.o_proj.max_weight_position	52.50
attn.o_proj.min_weight	1.39
attn.o_proj.min_weight_distance	49.92
mlp.down_proj.max_weight	1.21
mlp.down_proj.max_weight_position	54.38
mlp.down_proj.min_weight	0.76
mlp.down_proj.min_weight_distance	50.68

Metric	This model	Original model ([Darkhn/Mistral-Medium-3.5-128B-BF16-Text-Only](https://huggingface.co/Darkhn/Mistral-Medium-3.5-128B-BF16-Text-Only))
KL divergence	0.0329	0 (by definition)
Refusals	8/100	93/100