Sift β€” banking77 intent classifier (modernbert)

Fine-tuned answerdotai/ModernBERT-base on PolyAI/banking77 (77 fine-grained banking intents). Part of Sift, a query-triage project showing a small fine-tuned model beats a zero-shot open 7B instruct LLM (Mistral-7B-Instruct, run locally and 4-bit quantised) on cost, latency, and privacy for narrow, high-volume classification.

Metrics β€” full test split (3076 examples)

Metric Score
Accuracy 0.9353
Macro-F1 0.9353
Median single-query latency 22.47 ms (Tesla T4)

Intent -> team routing

The 77 intents are mapped to six routing teams: Cards, Payments, Accounts, Fraud/Security, Onboarding, General.

Usage

from transformers import pipeline
clf = pipeline("text-classification", model="DarioFrK/sift-banking77-modernbert", top_k=5)
clf("My card was swallowed by the ATM")
  • Base model: answerdotai/ModernBERT-base
  • Dataset: PolyAI/banking77
  • Training: 3 epochs, lr=5e-05, batch=16, max_len=64
Downloads last month
30
Safetensors
Model size
0.1B params
Tensor type
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for DarioFrK/sift-banking77-modernbert

Finetuned
(1351)
this model

Dataset used to train DarioFrK/sift-banking77-modernbert