Commit History

warm up onnx session at startup + tunable threads
c59ccf4

the-only-ashutosh commited on

feed zeros for required token_type_ids input
de7bd61

the-only-ashutosh commited on

run via raw onnxruntime, drop torch/optimum (version conflict)
d23fe11

the-only-ashutosh commited on

switch to int8 ONNX bge-m3 (optimum, CLS pooling)
bbad332

the-only-ashutosh commited on

vapi-sathi embed space: bge-m3 FastAPI /embed
3dc597f

the-only-ashutosh commited on