Intern-S1-pro transformers versions

#4
by DaleMeng - opened

Hi, thank you for releasing this model and for the great work!

According to the documentation, this model should work with:
transformers >= 4.53.0

I have some problem to use AutoModelForCausalLM.from_pretrained

with transformers == 4.57.0, we need to fix some code in modeling_interns1_pro.py,
@check_model_inputs() should be @check_model_inputs to make it works

with the latest transformers == 5.1.0, the code @check_model_inputs() has no problem but will report another errors
image
So what is the recommended transformers version to work with the modeling_interns1_pro.py ?

Intern Large Models org
edited 2 days ago

Thanks for the feedback! We usually recommend versions >=4.57.0 and <5.0. You’re right about that check_model_inputs error—that's on us, our code was a bit off there. We'll get that fixed. Also, just a heads-up: running a 1T model directly with Transformers might be a stretch. You'd probably have a much better time using LMDeploy instead.

Sign up or log in to comment