tianzl66/Llama-3.1-8B-Instruct-InstructionFollowing-LoRA

Llama-3.1-8B-Instruct + Instruction-Following LoRA

This repository contains the vanilla LoRA adapter used as the instruction-following SFT baseline for the Spectral Surgery experiments.

Base Model

meta-llama/Llama-3.1-8B-Instruct

Training

• —Sequence length: 1024
• —Global batch size: 128
• —LoRA rank: 16
• —Seed: 42

Evaluation

Evaluation on IFEval.

The vanilla LoRA checkpoint is used as the source checkpoint for the Spectral Surgery HNS 8+2 adapter.