Tiancheng Hu
commited on
Commit
·
efc4868
1
Parent(s):
220d239
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,8 +12,27 @@ metrics:
|
|
| 12 |
|
| 13 |
This is a T5 small model finetuned on CoNLL-2003 dataset for named entity recognition (NER).
|
| 14 |
|
| 15 |
-
Example
|
| 16 |
“Recognize all the named entities in this sequence (replace named entities with one of [PER], [ORG], [LOC], [MISC]): When Alice visited New York” → “When PER visited LOC LOC"
|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
|
|
|
|
| 12 |
|
| 13 |
This is a T5 small model finetuned on CoNLL-2003 dataset for named entity recognition (NER).
|
| 14 |
|
| 15 |
+
Example Input and Output:
|
| 16 |
“Recognize all the named entities in this sequence (replace named entities with one of [PER], [ORG], [LOC], [MISC]): When Alice visited New York” → “When PER visited LOC LOC"
|
| 17 |
|
| 18 |
+
Evaluation Result:
|
| 19 |
+
|
| 20 |
+
% of match (for comparison with ExT5: https://arxiv.org/pdf/2111.10952.pdf):
|
| 21 |
+
|
| 22 |
+
| Model| ExT5_{Base} | This Model | T5_NER_CONLL_OUTPUTLIST
|
| 23 |
+
| :---: | :---: | :---: | :---: |
|
| 24 |
+
| % of Complete Match| 86.53 | 79.03 | 123 |
|
| 25 |
+
|
| 26 |
+
|
| 27 |
+
|
| 28 |
+
There are some outputs (212/3453 that does not have the same length as the input)
|
| 29 |
+
|
| 30 |
+
F1 score on testing set of those with matching length:
|
| 31 |
+
|
| 32 |
+
| Attempt | #1 | #2 |
|
| 33 |
+
| :---: | :---: | :---: |
|
| 34 |
+
| Seconds | 301 | 283 |
|
| 35 |
+
|
| 36 |
+
|
| 37 |
|
| 38 |
|