How to export nougat model to onnx?
#8
by zhichyu - opened
Here's one exported to onnx https://huggingface.co/pszemraj/nougat-small-onnx.
There are three onnx model files after export: decoder_model.onnx, decoder_with_past_model.onnx, encoder_model.onnx.
However the author doesn't provide the details how he did that.
torch.onnx.export only export one model file model.onnx, and ORTModelForVision2Seq connot load it:
FileNotFoundError: Could not find any ONNX model file for the regex ['(.*)?decoder((?!(with_past|merged)).)*?\\.onnx'] in /home/zhichyu/model_dir/nougat.
Got clue from https://github.com/facebookresearch/nougat/issues/49optimum-cli will take care all of that.
zhichyu changed discussion status to closed