Reynier commited on
Commit
8ac9589
·
verified ·
1 Parent(s): 095b5ac

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -39,12 +39,12 @@ This repository contains the complete implementation of expert model evaluation
39
  | Model | Known F1 | Unknown F1 | Inference Time | Throughput |
40
  |-------|----------|------------|----------------|------------|
41
  | **ModernBERT** ⭐ | **86.7%** | **80.9%** | **26ms** | **38 domains/s** |
42
- | Gemma 3 4B LoRA | 82.1% | 75.3% | 650ms | 1.5k/s |
43
- | LLaMA 3.2 3B LoRA | 81.4% | 74.8% | 680ms | 1.4k/s |
44
- | DomBertUrl | 81.2% | 84.6% | 28ms | 35k/s |
45
- | CNN | 78.9% | 72.1% | 15ms | 66k/s |
46
- | FANCI (RF) | 77.3% | 68.5% | <1ms | >100k/s |
47
- | LABin | 75.6% | 70.2% | 18ms | 55k/s |
48
 
49
  **Key Improvement:** Specialist training provides **+9.4% F1-score improvement** over generalist approaches on known families and **+30.2%** on unseen families.
50
 
 
39
  | Model | Known F1 | Unknown F1 | Inference Time | Throughput |
40
  |-------|----------|------------|----------------|------------|
41
  | **ModernBERT** ⭐ | **86.7%** | **80.9%** | **26ms** | **38 domains/s** |
42
+ | Gemma 3 4B LoRA | 82.1% | 75.3% | 650ms | 1.5/s |
43
+ | LLaMA 3.2 3B LoRA | 81.4% | 74.8% | 680ms | 1.4/s |
44
+ | DomBertUrl | 81.2% | 84.6% | 28ms | 35/s |
45
+ | CNN | 78.9% | 72.1% | 15ms | 66/s |
46
+ | FANCI (RF) | 77.3% | 68.5% | <1ms | >100/s |
47
+ | LABin | 75.6% | 70.2% | 18ms | 55/s |
48
 
49
  **Key Improvement:** Specialist training provides **+9.4% F1-score improvement** over generalist approaches on known families and **+30.2%** on unseen families.
50