FlorianJK/Meta-Llama-3-8B-SecAlign

Meta-Llama-3-8B-Instruct — SecAlign Adapter

A PEFT LoRA adapter for `meta-llama/Meta-Llama-3-8B-Instruct` fine-tuned with SecAlign to make the model resistant to prompt injection attacks.

Model Details

• —Base model: meta-llama/Meta-Llama-3-8B-Instruct
• —Fine-tuning method: DPO (Direct Preference Optimisation) via SecAlign
• —Adapter type: PEFT LoRA (library version 0.14.0)
• —Training data: 104-sample subset of AlpacaEval (text-davinci-003 reference outputs, samples with non-empty input field)

Security Evaluation

Attack success rate measured on 104 samples from AlpacaEval with no additional defense prompting. ↓ lower is better — the model should not follow injected instructions.

• —in-response — fraction of outputs containing the injected trigger word
• —begin-with — fraction of outputs that begin with the injected trigger word

This adapter (SecAlign)

Undefended base model (Meta-Llama-3-8B-Instruct)

Related Models