sheethal00's picture
Update README.md
1b66f33 verified
|
Raw
History Blame Contribute Delete
1.17 kB
---
tags:
- deprecated
---
# ⚠️ Deprecated — Ticket Classifier (v1)
**This model is deprecated.** It was trained on a synthetic dataset with a known labeling
issue in the `general` category (see details below), which significantly understated its
usable accuracy. It is kept here only for reproducibility and as a before/after reference.
**Use [`sheethal00/ticket-classifier-lora`](https://huggingface.co/sheethal00/ticket-classifier-lora) instead.**
## Why this version was deprecated
The data generation prompt for the `general` category had no positive definition
("everything else"), causing generated tickets to overlap heavily with the other four
categories. This model's real classification ability was masked by noisy validation
labels — measured accuracy was 71.7% / F1 (macro) 0.704, compared to 95.1% / 0.953
after the labeling issue was fixed and the model retrained. See the main repo's model
card for the full before/after comparison.
## Training details
Same architecture and hyperparameters as v2 (LoRA rank 16, alpha 32, target modules
q_proj/v_proj, base model meta-llama/Llama-3.2-1B) — the only difference is the
training data quality.