Elib27/llama-3.2-1b-commit-msg-lora

Llama-3.2-1B-Instruct — Commit Message LoRA Adapter

LoRA adapter fine-tuned on top of `meta-llama/Llama-3.2-1B-Instruct` to generate Conventional Commits messages from a git diff.

Part of a project to build a local, offline prepare-commit-msg git hook. Full write-up: https://eliotbas.com/projects/commits-fine-tuning/ Training dataset: https://huggingface.co/datasets/Elib27/commits

Training details

• —Method: LoRA (r=16, alpha=32)
• —Framework: Unsloth + TRL SFTTrainer
• —Hardware: Google Colab A100
• —Dataset: ~11k (diff, commit message) pairs, see eliotbas/commits

See the article for full evaluation results (ROUGE-L, structural checks, LLM-as-judge) across all model sizes.