Modelpublic

grimjim/Nemo-Instruct-2407-MPOA-v2-12B

sourceHugging Faceapache-2.0updated 10mo agoView on Hugging Face

4likes24downloads

Model Card

Nemo-Instruct-2407-MPOA-v2-12B

MPOA (Magnitude-Preserving Othogonalized Ablation, AKA norm-preserving biprojected abliteration) has been applied the many of the layers in this model, to both mlp.downproj.weight and selfattn.o_proj.weight streams.

Compliance was not maximized for this model. The model appears to be near an edge of chaos with regard to some safety refusals, which should be suitable for varied text completion.

More details pending.