Instructions to use Roblox/roblox-pii-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Roblox/roblox-pii-classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Roblox/roblox-pii-classifier")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("Roblox/roblox-pii-classifier") model = AutoModelForSequenceClassification.from_pretrained("Roblox/roblox-pii-classifier", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add ONNX export w/ `optimum-onnx`
Browse files# Description
This PR adds the ONNX weights exported with [`optimum-onnx`](https://github.com/huggingface/optimum-onnx) as:
```python
from optimum.onnxruntime import ORTModelForCausalLM
model = ORTModelForCausalLM.from_pretrained("Roblox/roblox-pii-classifier", export=True)
model.save_pretrained("onnx/")
```
To be later on used via Python as follows (amongst many other options leveraging ONNX):
```python
from transformers import AutoTokenizer, pipeline
from optimum.onnxruntime import ORTModelForCausalLM
model = ORTModelForCausalLM.from_pretrained("Roblox/roblox-pii-classifier", revision="refs/pr/", subfolder="onnx/")
tokenizer = AutoTokenizer.from_pretrained("Roblox/roblox-pii-classifier", revision="refs/pr/")
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
pipe("He never went out without a book under his arm")
```
Thanks 🤗
- .gitattributes +1 -0
- onnx/model.onnx +3 -0
- onnx/model.onnx_data +3 -0
|
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
onnx/model.onnx_data filter=lfs diff=lfs merge=lfs -text
|
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:44636d7bd1c791f1e1f16545236d011c04a935fe721117dd9dd7ee72a0b2ee0e
|
| 3 |
+
size 489245
|
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:290aacb35766124a3425ba4ccb027244dfd38c47fc28cddddb9bab52df1a698b
|
| 3 |
+
size 2239574032
|