README.md

---
base_model: meta-llama/Llama-3.2-1B-Instruct
library_name: peft
tags:
- lora
- commit-message-generation
- conventional-commits
- code
---

# Llama-3.2-1B-Instruct — Commit Message LoRA Adapter

LoRA adapter fine-tuned on top of [`meta-llama/Llama-3.2-1B-Instruct`](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct)
to generate [Conventional Commits](https://www.conventionalcommits.org/) messages from a `git diff`.

Part of a project to build a local, offline `prepare-commit-msg` git hook.
Full write-up: https://eliotbas.com/projects/commits-fine-tuning/
Training dataset: https://huggingface.co/datasets/Elib27/commits


## Training details

- Method: LoRA (r=16, alpha=32)
- Framework: Unsloth + TRL SFTTrainer
- Hardware: Google Colab A100
- Dataset: ~11k (diff, commit message) pairs, see [eliotbas/commits](https://huggingface.co/datasets/Elib27/commits)

See the article for full evaluation results (ROUGE-L, structural checks, LLM-as-judge) across all model sizes.