Upload model.onnx
#4
by bergum - opened
Add ONNX model artifact for efficient inference using onnxruntime.
okhattab changed pull request status to merged
Hi @bergum , I want to convert jina-colbert checkpoint to ONNX and use the same exported format with ColBERTv2's. Would you mind sharing how you convert?
Hi @bergum , I want to convert jina-colbert checkpoint to ONNX and use the same exported format with ColBERTv2's. Would you mind sharing how you convert?
https://github.com/vespa-engine/sample-apps/blob/master/colbert/model2onnx.py