Joint Intent + NER Model for Norwegian Feed Orders
A joint intent classification and named entity recognition model for Norwegian animal feed order queries, fine-tuned from NbAiLab/nb-bert-large.
Task
Given a Norwegian spoken order query, the model simultaneously:
- Classifies the intent (5 classes):
create_order,edit_order,confirm,reject,help - Extracts named entities (7 entity types, IOB2):
PRODUCT,QUANTITY,UNIT,DELIVERY_METHOD,DELIVERY_DATE,ADDRESS,TANK_SILO
Test Set Results
| Metric | Score |
|---|---|
| NER Precision | 92.71% |
| NER Recall | 95.19% |
| NER F1 | 93.93% |
| Intent Accuracy | 100% |
| Intent F1 | 100% |
| Combined F1 | 96.97% |
Training
- Base model: NbAiLab/nb-bert-large (1024 hidden, 24 layers)
- Training data: 450 examples (train + val merged after HP search)
- Hyperparameters: Found via Optuna search (20 trials), then retrained on train+val
- Loss:
0.6 * intent_loss + 0.4 * ner_loss - Epochs: 5
- Learning rate: 5e-05
- Batch size: 8
Model tree for eVici-AS/joint-intent-ner
Base model
NbAiLab/nb-bert-large