fix DictaBERT-lex characterization
Browse files
README.md
CHANGED
|
@@ -49,7 +49,8 @@ lz.lemma("讛诪讟注谞讬诐", "讛讜讗 驻专拽 讗转 讛诪讟注谞讬诐 诪讛诪砖讗讬转.")
|
|
| 49 |
- Lemma accuracy **92.4%** out-of-domain (94.3% in-domain).
|
| 50 |
- B鲁 consistency leads DictaBERT-lex on both precision and recall
|
| 51 |
(0.965 / 0.953 vs 0.906 / 0.932).
|
| 52 |
-
- **0.0%** low-overlap errors on unseen words, vs 12.3% for
|
|
|
|
| 53 |
|
| 54 |
DictaBERT-lex was trained on more data than is used here, including the domains
|
| 55 |
held out for evaluation, so the comparison is conservative.
|
|
|
|
| 49 |
- Lemma accuracy **92.4%** out-of-domain (94.3% in-domain).
|
| 50 |
- B鲁 consistency leads DictaBERT-lex on both precision and recall
|
| 51 |
(0.965 / 0.953 vs 0.906 / 0.932).
|
| 52 |
+
- **0.0%** low-overlap errors on unseen words, vs 12.3% for DictaBERT-lex (which
|
| 53 |
+
predicts each lemma as a single token from its vocabulary).
|
| 54 |
|
| 55 |
DictaBERT-lex was trained on more data than is used here, including the domains
|
| 56 |
held out for evaluation, so the comparison is conservative.
|