README
Browse files
README.md
CHANGED
|
@@ -96,21 +96,17 @@ print(pii_classes)
|
|
| 96 |
### Testing Data, Factors & Metrics
|
| 97 |
|
| 98 |
#### Testing Data
|
| 99 |
-
1. We developed an in house testset that we evaluate the model on. The test set was manually annotated to ensure high quality of the test set.
|
| 100 |
|
| 101 |
|
| 102 |
#### Metrics
|
| 103 |
|
| 104 |
-
|
| 105 |
|
| 106 |
-
|
| 107 |
-
|
| 108 |
-
### Results
|
| 109 |
-
|
| 110 |
-
[More Information Needed]
|
| 111 |
-
|
| 112 |
-
#### Summary
|
| 113 |
|
|
|
|
|
|
|
| 114 |
|
| 115 |
## Model Card Authors
|
| 116 |
|
|
|
|
| 96 |
### Testing Data, Factors & Metrics
|
| 97 |
|
| 98 |
#### Testing Data
|
| 99 |
+
1. We developed an in house testset that we evaluate the model on. The test set was manually annotated to ensure high quality of the test set. The test set mainly comprises of financial documents , contracts etc across all the 7 languages, covering all the classes.
|
| 100 |
|
| 101 |
|
| 102 |
#### Metrics
|
| 103 |
|
| 104 |
+
1. We used precision , recall and F1 score to evaluate the models output with the ground truth.
|
| 105 |
|
| 106 |
+
We consider precision and recall to be:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 107 |
|
| 108 |
+
Precision: The ratio of correctly identified PII instances to the total identified instances.
|
| 109 |
+
Recall: The ratio of correctly identified PII instances to the total actual instances in the dataset.
|
| 110 |
|
| 111 |
## Model Card Authors
|
| 112 |
|