CoolFace
Modelpublic

JoaoBoer/tofu_Llama-3.2-3B-Instruct_forget05_IdkNLL

sourceHugging Facellama3.2updated 17d agoView on Hugging Face
0likes55downloads
Model Card

tofuLlama-3.2-3B-Instructforget05_IdkNLL

open-unlearning/tofu_Llama-3.2-3B-Instruct_full unlearned on the TOFU forget05 split with IdkNLL, trained with the open-unlearning framework. Used as a weight-unlearning baseline / draft model in the Speculative-Decoding-Unlearning project.

Full training config: .hydra/config.yaml. TOFU evaluation outputs: evals/.

Method hyperparameters

yaml
gamma: -1.0
alpha: 2
retain_loss_type: NLL

TOFU summary metrics

metricvalue
exact_memorization0.7860
extraction_strength0.1875
forgetQAPARAProb0.0986
forgetQA_gibberish0.9625
forget_quality0.0002
forgettruthratio0.5782
mia_loss0.9195
miamink0.9213
miaminkplusplus0.9266
mia_zlib0.8537
model_utility0.4533
privleak-87.6984