Benchmark Summary
ONNX q8
| Suite | F1 | Examples/s |
|---|---|---|
| Irish core | 0.9733 | 249.2250 |
| Edge | 0.9500 | 270.3631 |
| Finance | 1.0000 | 125.7428 |
| Finance boundary | 1.0000 | 227.6344 |
| User PPSN | - | - |
| GA weak PPSN | 1.0000 | 122.3801 |
| Multilingual PPSN | 0.9379 | 247.4313 |
| Hardening exact | 1.0000 | 186.9048 |
| QA feedback exact | 1.0000 | 132.7204 |
| UAT replay exact | 0.9032 | 181.4653 |
Full checkpoint
| Suite | F1 | Examples/s |
|---|---|---|
| Irish core | 0.9733 | 47.4557 |
| Edge | - | - |
| Multilingual PPSN | - | - |
| Hardening exact | - | - |
QA feedback exact, strict boundary (IoU 1.0) |
0.9444 | - |