Text Classification
Transformers
ONNX
Safetensors
multilingual
xlm-roberta
privacy
pii-detection
text-embeddings-inference
Instructions to use Roblox/roblox-pii-classifier-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Roblox/roblox-pii-classifier-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Roblox/roblox-pii-classifier-v2")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("Roblox/roblox-pii-classifier-v2") model = AutoModelForSequenceClassification.from_pretrained("Roblox/roblox-pii-classifier-v2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -70,10 +70,9 @@ The table below illustrates best f1 performance across internal and open-source
|
|
| 70 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 71 |
| **roblox-pii-safety-for-chat** | **88.78%** | 64.74% | 58.10% | 54.42% | 66.15% | 27.80% | 56.06% | 54.30% | 56.35% | 58.34% | 57.66 |
|
| 72 |
| **Roblox Internal Evalution** | **90.52%** | 63.41% | 20.98% | 28.21% | 15.62% | 8.59% | 12.90% | 21.92% | 14.77% | 20.98% | 31.87 |
|
| 73 |
-
| **Nemotron-PII** | **99.22%** | 70.07% |
|
| 74 |
-
| **PII Masking OpenPII 1.5M** | **99.76%** | 86.79% | 84.23% | 83.07% | 61.94% | 65.10% | 64.23% | 56.16% | 54.
|
| 75 |
| **PII Masking 400k** | **97.64%** | 97.44% | 72.66% | 72.28% | 48.83% | 52.41% | 49.64% | 42.48% | 49.82% | 97.09% | 67.13 |
|
| 76 |
-
| **Beavertails** | 63.24% | 60.54% | 59.36% | 27.83% | 66.74% | 64.03% | 64.95% | **68.65%** | 65.45% | 61.76% | 68.62 |
|
| 77 |
|
| 78 |
\* These models all were supplied with only the target-user text as other speaker texts are meant to be supplemental contextual information. roblox-pii-classifier-v2 performs best when supplied with conversational context, however it still outperforms roblox-pii-classifier when supplied only with target-user text.
|
| 79 |
|
|
|
|
| 70 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
| 71 |
| **roblox-pii-safety-for-chat** | **88.78%** | 64.74% | 58.10% | 54.42% | 66.15% | 27.80% | 56.06% | 54.30% | 56.35% | 58.34% | 57.66 |
|
| 72 |
| **Roblox Internal Evalution** | **90.52%** | 63.41% | 20.98% | 28.21% | 15.62% | 8.59% | 12.90% | 21.92% | 14.77% | 20.98% | 31.87 |
|
| 73 |
+
| **Nemotron-PII** | **99.22%** | 70.07% | 65.22% | 62.92% | 37.46% | 53.32% | 46.07% | 35.05% | 56.16% | 68.52% | 56.69 |
|
| 74 |
+
| **PII Masking OpenPII 1.5M** | **99.76%** | 86.79% | 84.23% | 83.07% | 61.94% | 65.10% | 64.23% | 56.16% | 54.01% | 86.35% | 85.33 |
|
| 75 |
| **PII Masking 400k** | **97.64%** | 97.44% | 72.66% | 72.28% | 48.83% | 52.41% | 49.64% | 42.48% | 49.82% | 97.09% | 67.13 |
|
|
|
|
| 76 |
|
| 77 |
\* These models all were supplied with only the target-user text as other speaker texts are meant to be supplemental contextual information. roblox-pii-classifier-v2 performs best when supplied with conversational context, however it still outperforms roblox-pii-classifier when supplied only with target-user text.
|
| 78 |
|