junior-associate / README.md
Curious-PM's picture
Upload folder using huggingface_hub
8b4cfbd verified
|
Raw
History Blame Contribute Delete
986 Bytes
---
title: Junior Associate
emoji: 📄
colorFrom: indigo
colorTo: gray
sdk: gradio
sdk_version: 5.7.1
python_version: "3.12"
app_file: app.py
pinned: false
license: apache-2.0
hardware: zero-a10g
short_description: Qwen-3B fine-tuned for contract review in IRAC format
---
# Junior Associate · Contract Review in IRAC
Qwen 2.5-3B-Instruct fine-tuned with LoRA on 80 hand-crafted contract-review memos. Every reply produces the firm's IRAC house format with mandatory top + bottom disclaimers.
Built for the Curious PM "Stay Curious" session on fine-tuning. Trained via the [`hf-llm-trainer`](https://huggingface.co/blog/hf-skills-training) Claude skill on Hugging Face Jobs.
## Model
- Base: `Qwen/Qwen2.5-3B-Instruct`
- Adapter: [`Curious-PM/lexwell-contract-irac-qwen2.5-3b-lora`](https://huggingface.co/Curious-PM/lexwell-contract-irac-qwen2.5-3b-lora)
- LoRA: `r=16`, `alpha=32`, attention modules only
- Training: 10 epochs, batch 2 × grad-accum 2, lr 2e-4, ~7 min on A10G