Share onnx conversion script
Can you share the script to convert to onnx, this is very useful for anyone finetuning this model as existing libraries do not support onnx conversion for this yet.
Should be supported by normal ONNX, its just a model in HF format.
We didn't run the conversion ourselves, but I can check.
Last I checked optimum does not support this yet (what I usually use for MoE), using standard ONNX converts it to a dense model and you lose the speed benefits.
Anyone have solution for this?
We didn't run the conversion ourselves, but I can check.
Hi @mihaimaruseac ,
I'm running openai/privacy-filter via the published ONNX artifacts and are planning to fine-tune on my data to reduce false positive. I'm stuck on re-exporting ONNX from a fine-tuned checkpoint, so if you have any guidance or tooling to share, i would really appreciate it. Thank you!