Dmitry43243242/icd10-ru-subgroup-a

ICD-10 subgroup classifier - group A (distilled specialist)

Multi-label classifier over 3-character ICD-10 subgroups inside chapter A. This specialist was distilled from local BERT teacher models into alexyalunin/RuBioBERT. Teacher weights are not uploaded to Hugging Face.

Intended use / Назначение

• EN: Decision-support signal for suggesting candidate ICD-10 subgroups from Russian clinical notes. Not a substitute for clinician judgment; not validated for autonomous diagnosis.
• RU: Вспомогательный сигнал для предложения кандидатных 3-символьных кодов МКБ-10 по русскому клиническому тексту. Не заменяет врача и не предназначен для автономных клинических решений.

Training data / Обучающие данные

• Source CSV: datasets/subgroups/group_A.csv
• SHA-256: 9fdda9bea147993b7b553434593650caa041861a9d060357b0f39f6b7cb5eab4
• Splits: train=203 · val=42 · test=41
• Labels: 35; rare/interface-only ids are listed in label_map.json.

Training route

• Approach: direct_hard_training_no_distillation
• Base model: alexyalunin/RuBioBERT
• Direct validation hit@3: 0.9761904761904762
• No-distillation threshold: 0.9
• Teacher models (fallback KD only): []
• Selected KD config (fallback only): temperature=None, hard_loss_weight=None

Metrics (test split)

metric	final specialist	teacher ensemble / fallback
macro_f1	0.5124
micro_f1	0.5191
weighted_f1	0.5752
subset_accuracy	0.1220
hit@1	0.9268
hit@3	1.0000
recall@3	0.9329
mrr	0.9553

Full per-label breakdown is available in metrics.json.

Inference

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

repo = "Dmitry43243242/icd10-ru-subgroup-a"
tok = AutoTokenizer.from_pretrained(repo)
mdl = AutoModelForSequenceClassification.from_pretrained(repo)
mdl.eval()

text = "жалобы пациента..."
inp = tok(text, return_tensors="pt", truncation=True, max_length=512)
with torch.no_grad():
    probs = torch.sigmoid(mdl(**inp).logits)[0]
preds = [mdl.config.id2label[i] for i, p in enumerate(probs.tolist()) if p >= 0.5]
top5 = sorted(
    [(mdl.config.id2label[i], p) for i, p in enumerate(probs.tolist())],
    key=lambda x: -x[1],
)[:5]
print(preds, top5)