Text Classification
Transformers
ONNX
Safetensors
multilingual
xlm-roberta
privacy
pii-detection
text-embeddings-inference
jordansren commited on
Commit
34df8ba
·
verified ·
1 Parent(s): 1718f62

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -70,10 +70,9 @@ The table below illustrates best f1 performance across internal and open-source
70
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
71
  | **roblox-pii-safety-for-chat** | **88.78%** | 64.74% | 58.10% | 54.42% | 66.15% | 27.80% | 56.06% | 54.30% | 56.35% | 58.34% | 57.66 |
72
  | **Roblox Internal Evalution** | **90.52%** | 63.41% | 20.98% | 28.21% | 15.62% | 8.59% | 12.90% | 21.92% | 14.77% | 20.98% | 31.87 |
73
- | **Nemotron-PII** | **99.22%** | 70.07% | 56.10% | 62.90% | 37.50% | 53.32% | 46.10% | 37.50% | 56.20% | 68.50% | 56.69 |
74
- | **PII Masking OpenPII 1.5M** | **99.76%** | 86.79% | 84.23% | 83.07% | 61.94% | 65.10% | 64.23% | 56.16% | 54.02% | 86.35% | 89.32 |
75
  | **PII Masking 400k** | **97.64%** | 97.44% | 72.66% | 72.28% | 48.83% | 52.41% | 49.64% | 42.48% | 49.82% | 97.09% | 67.13 |
76
- | **Beavertails** | 63.24% | 60.54% | 59.36% | 27.83% | 66.74% | 64.03% | 64.95% | **68.65%** | 65.45% | 61.76% | 68.62 |
77
 
78
  \* These models all were supplied with only the target-user text as other speaker texts are meant to be supplemental contextual information. roblox-pii-classifier-v2 performs best when supplied with conversational context, however it still outperforms roblox-pii-classifier when supplied only with target-user text.
79
 
 
70
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
71
  | **roblox-pii-safety-for-chat** | **88.78%** | 64.74% | 58.10% | 54.42% | 66.15% | 27.80% | 56.06% | 54.30% | 56.35% | 58.34% | 57.66 |
72
  | **Roblox Internal Evalution** | **90.52%** | 63.41% | 20.98% | 28.21% | 15.62% | 8.59% | 12.90% | 21.92% | 14.77% | 20.98% | 31.87 |
73
+ | **Nemotron-PII** | **99.22%** | 70.07% | 65.22% | 62.92% | 37.46% | 53.32% | 46.07% | 35.05% | 56.16% | 68.52% | 56.69 |
74
+ | **PII Masking OpenPII 1.5M** | **99.76%** | 86.79% | 84.23% | 83.07% | 61.94% | 65.10% | 64.23% | 56.16% | 54.01% | 86.35% | 85.33 |
75
  | **PII Masking 400k** | **97.64%** | 97.44% | 72.66% | 72.28% | 48.83% | 52.41% | 49.64% | 42.48% | 49.82% | 97.09% | 67.13 |
 
76
 
77
  \* These models all were supplied with only the target-user text as other speaker texts are meant to be supplemental contextual information. roblox-pii-classifier-v2 performs best when supplied with conversational context, however it still outperforms roblox-pii-classifier when supplied only with target-user text.
78