Ttimms/sovereign-edge-intent-router

sovereign-edge Intent Router

DistilBERT fine-tuned for 5-class single-label intent classification, routing user queries to one of five domain experts in a LangGraph multi-agent system deployed on a Jetson Orin Nano.

Status: snapshot, not under active development right now. This is the router model behind the sovereign-edge project, which is mid re-architecture. It may be retrained or superseded — check the GitHub repo for the current state before assuming this is the latest version.

What this is part of

This model is Tier 2 of a three-tier intent router: embedding similarity (Tier 1) → this DistilBERT classifier (Tier 2) → keyword matching (Tier 3, always-available fallback). The system degrades gracefully without this model — see packages/router/src/router/classifier.py in the GitHub repo for the full routing logic.

Labels

ID	Label
0	spiritual
1	career
2	intelligence
3	creative
4	goals

Each label routes to a dedicated LangGraph expert subgraph.

Formats included

Path	Format	Size	Use case
hf_model/	HF transformers (safetensors)	256 MB	Fine-tuning, evaluation, re-export
router_fp32.onnx (+ .onnx.data)	ONNX, fp32	536 MB	Reference export, re-quantization source
router.onnx	ONNX, INT8 quantized	64 MB	Production — deployed on Jetson Orin Nano CPU, <10ms inference

Usage

HF transformers

from transformers import AutoModelForSequenceClassification, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Ttimms/sovereign-edge-intent-router", subfolder="hf_model")
model = AutoModelForSequenceClassification.from_pretrained("Ttimms/sovereign-edge-intent-router", subfolder="hf_model")

ONNX (production path)

import onnxruntime as ort
from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Ttimms/sovereign-edge-intent-router", subfolder="hf_model")
session = ort.InferenceSession("router.onnx")  # download router.onnx from this repo
inputs = tokenizer("How do I plan my week better?", return_tensors="np")
outputs = session.run(None, dict(inputs))

Training

Trained with scripts/train-router.py in the GitHub repo — standard HF Trainer fine-tune of distilbert-base-uncased for 5-way single-label sequence classification.

License

MIT — matches the upstream project license.