Elib27/qwen2.5-coder-1.5b-commit-msg-lora

Qwen2.5-Coder-1.5B-Instruct — Commit Message LoRA Adapter

LoRA adapter fine-tuned on top of `Qwen/Qwen2.5-Coder-1.5B-Instruct` to generate Conventional Commits messages from a git diff.

Part of a project to build a local, offline prepare-commit-msg git hook. Full write-up: https://eliotbas.com/projects/commits-fine-tuning/ Training dataset: https://huggingface.co/datasets/Elib27/commits

Training details

• —Method: LoRA (r=16, alpha=32)
• —Framework: Unsloth + TRL SFTTrainer
• —Hardware: Google Colab A100
• —Dataset: ~11k (diff, commit message) pairs, see eliotbas/commits

See the article for full evaluation results (ROUGE-L, structural checks, LLM-as-judge) across all model sizes.