File size: 1,001 Bytes
b4f2782 1a4a5ff b4f2782 1a4a5ff b4f2782 1a4a5ff b4f2782 1a4a5ff b4f2782 32a9575 b4f2782 1a4a5ff b4f2782 1a4a5ff b4f2782 1a4a5ff | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 | ---
base_model: Qwen/Qwen2.5-Coder-0.5B-Instruct
library_name: peft
tags:
- lora
- commit-message-generation
- conventional-commits
- code
---
# Qwen2.5-Coder-0.5B-Instruct — Commit Message LoRA Adapter
LoRA adapter fine-tuned on top of [`Qwen/Qwen2.5-Coder-0.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-Coder-0.5B-Instruct)
to generate [Conventional Commits](https://www.conventionalcommits.org/) messages from a `git diff`.
Part of a project to build a local, offline `prepare-commit-msg` git hook.
Full write-up: https://eliotbas.com/projects/commits-fine-tuning/
Training dataset: https://huggingface.co/datasets/Elib27/commits
## Training details
- Method: LoRA (r=16, alpha=32)
- Framework: Unsloth + TRL SFTTrainer
- Hardware: Google Colab A100
- Dataset: ~11k (diff, commit message) pairs, see [eliotbas/commits](https://huggingface.co/datasets/Elib27/commits)
See the article for full evaluation results (ROUGE-L, structural checks, LLM-as-judge) across all model sizes.
|