What Python version/dependency versions are needed to run this model?
#3
by
luciancap001
- opened
I'm running Python 3.8.19, transformers 4.42.3, onnx 1.16.1, & onnxruntime 1.18.1 however when I try to run the model using the code snippet on the model card I get a Onnxruntime error of:
Fail: [ONNXRuntimeError] : 1 : FAIL : Deserialize tensor model.layers.31.attn.o_proj.MatMul.weight failed.GetFileLength for ./Mistral-7B-v0.1.onnx.data failed:Invalid fd was supplied: -1
Any thoughts?
The conflict is caused by:
The user requested protobuf==3.20.2
onnx 1.18.0 depends on protobuf>=4.25.1
%cd onnxruntime
!python3 -m pip install -r onnxruntime/python/tools/transformers/models/llama/requirements-cpu.txt
The conflict is caused by:
The user requested protobuf==3.20.2
onnx 1.18.0 depends on protobuf>=4.25.1