yezdata commited on
Commit
45e6a77
·
verified ·
1 Parent(s): f7dc602

UPDATE EmCoder TO V2

Browse files
Files changed (1) hide show
  1. README.md +6 -8
README.md CHANGED
@@ -53,15 +53,13 @@ EmCoder is optimized for **MC Dropout inference**.
53
 
54
  ## SOTA benchmark
55
  ### Evaluation on the GoEmotions test split (macro avg metrics)
56
- <!-- TODO: UPDATE % SIZE-->
57
  EmCoder achieves highly competitive Macro F1-score with its compact size (~35% smaller than RoBERTa-base and ~45% smaller than ModernBERT), while providing per-class epistemic uncertainty quantification.
58
- <!-- TODO: UPDATE PARAM COUNT -->
59
- | Model | Precision | Recall | F1-Score | Params |
60
- | :--- | :--- | :--- | :--- | :--- |
61
- | **EmCoder** | **0.503** | **0.503** | **0.488** | **82.1M** |
62
- | Google BERT (Original) | 0.400 | 0.630 | 0.460 | 110M |
63
- | RoBERTa-base | 0.575 | 0.396 | 0.450 | 125M |
64
- | ModernBERT-base | 0.583 | 0.535 | 0.550 | 149M |
65
 
66
 
67
  ## How to use
 
53
 
54
  ## SOTA benchmark
55
  ### Evaluation on the GoEmotions test split (macro avg metrics)
 
56
  EmCoder achieves highly competitive Macro F1-score with its compact size (~35% smaller than RoBERTa-base and ~45% smaller than ModernBERT), while providing per-class epistemic uncertainty quantification.
57
+ | Model | Precision | Recall | F1-Score | Params | F1/M |
58
+ | :--- | :--- | :--- | :--- | :--- | :--- |
59
+ | **EmCoder** | **0.503** | **0.503** | **0.488** | **81.8M** | **0.0060** |
60
+ | Google BERT (Original) | 0.400 | 0.630 | 0.460 | 110M | 0.0042 |
61
+ | RoBERTa-base | 0.575 | 0.396 | 0.450 | 125M | 0.0036 |
62
+ | ModernBERT-base | 0.583 | 0.535 | 0.550 | 149M | 0.0037 |
 
63
 
64
 
65
  ## How to use