alvarobartt HF Staff commited on
Commit
4f0dba4
·
verified ·
1 Parent(s): fc3e073

Add ONNX export w/ `optimum-onnx`

Browse files

# Description

This PR adds the ONNX weights exported with [`optimum-onnx`](https://github.com/huggingface/optimum-onnx) as:

```python
from optimum.onnxruntime import ORTModelForCausalLM

model = ORTModelForCausalLM.from_pretrained("Roblox/roblox-pii-classifier", export=True)
model.save_pretrained("onnx/")
```

To be later on used via Python as follows (amongst many other options leveraging ONNX):

```python
from transformers import AutoTokenizer, pipeline
from optimum.onnxruntime import ORTModelForCausalLM

model = ORTModelForCausalLM.from_pretrained("Roblox/roblox-pii-classifier", revision="refs/pr/", subfolder="onnx/")
tokenizer = AutoTokenizer.from_pretrained("Roblox/roblox-pii-classifier", revision="refs/pr/")

pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
pipe("He never went out without a book under his arm")
```

Thanks 🤗

Files changed (3) hide show
  1. .gitattributes +1 -0
  2. onnx/model.onnx +3 -0
  3. onnx/model.onnx_data +3 -0
.gitattributes CHANGED
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ onnx/model.onnx_data filter=lfs diff=lfs merge=lfs -text
onnx/model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44636d7bd1c791f1e1f16545236d011c04a935fe721117dd9dd7ee72a0b2ee0e
3
+ size 489245
onnx/model.onnx_data ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:290aacb35766124a3425ba4ccb027244dfd38c47fc28cddddb9bab52df1a698b
3
+ size 2239574032