Update README.md
Browse files
README.md
CHANGED
|
@@ -39,12 +39,12 @@ This repository contains the complete implementation of expert model evaluation
|
|
| 39 |
| Model | Known F1 | Unknown F1 | Inference Time | Throughput |
|
| 40 |
|-------|----------|------------|----------------|------------|
|
| 41 |
| **ModernBERT** ⭐ | **86.7%** | **80.9%** | **26ms** | **38 domains/s** |
|
| 42 |
-
| Gemma 3 4B LoRA | 82.1% | 75.3% | 650ms | 1.
|
| 43 |
-
| LLaMA 3.2 3B LoRA | 81.4% | 74.8% | 680ms | 1.
|
| 44 |
-
| DomBertUrl | 81.2% | 84.6% | 28ms |
|
| 45 |
-
| CNN | 78.9% | 72.1% | 15ms |
|
| 46 |
-
| FANCI (RF) | 77.3% | 68.5% | <1ms | >
|
| 47 |
-
| LABin | 75.6% | 70.2% | 18ms |
|
| 48 |
|
| 49 |
**Key Improvement:** Specialist training provides **+9.4% F1-score improvement** over generalist approaches on known families and **+30.2%** on unseen families.
|
| 50 |
|
|
|
|
| 39 |
| Model | Known F1 | Unknown F1 | Inference Time | Throughput |
|
| 40 |
|-------|----------|------------|----------------|------------|
|
| 41 |
| **ModernBERT** ⭐ | **86.7%** | **80.9%** | **26ms** | **38 domains/s** |
|
| 42 |
+
| Gemma 3 4B LoRA | 82.1% | 75.3% | 650ms | 1.5/s |
|
| 43 |
+
| LLaMA 3.2 3B LoRA | 81.4% | 74.8% | 680ms | 1.4/s |
|
| 44 |
+
| DomBertUrl | 81.2% | 84.6% | 28ms | 35/s |
|
| 45 |
+
| CNN | 78.9% | 72.1% | 15ms | 66/s |
|
| 46 |
+
| FANCI (RF) | 77.3% | 68.5% | <1ms | >100/s |
|
| 47 |
+
| LABin | 75.6% | 70.2% | 18ms | 55/s |
|
| 48 |
|
| 49 |
**Key Improvement:** Specialist training provides **+9.4% F1-score improvement** over generalist approaches on known families and **+30.2%** on unseen families.
|
| 50 |
|