HikmaAI Bias Detector (Multilingual)
6-class bias detection across 11 languages on mdeberta-v3-base.
| Metric | Value |
|---|---|
| Base model | microsoft/mdeberta-v3-base |
| Labels | unbiased, gender, racial, religious, political, other_bias |
| Languages | 11 ADR-001 |
| Training data | 101K samples |
| F1 | 0.920 (internal) |
Benchmark vs ProtectAI (distilroberta-bias)
| Dataset | HikmaAI | ProtectAI |
|---|---|---|
| BABE | 0.603 | 0.310 |
| MBIB gender | 0.626 | 0.295 |
| MBIB racial | 0.530 | 0.323 |
| MBIB political | 0.401 | 0.386 |
| MBIB text_level | 0.612 | 0.264 |
| Average | 0.555 | 0.316 |