transformer/lm-eval version compatibilty
#4
by ishanibasak - opened
Hello, could you share what versions are compatible with this model for lm-eval and transformers? After my on experimentation, I have found that transformers 4.57.x does not work with this model but 5.x does. So with this transformers version I have tested lm-eval 0.4.9.1 (which I had been using with other LFM2 models) and 0.4.11 (the most recent version) and neither of these work.
0.4.9.1 gives: AttributeError: module transformers has no attribute AutoModelForVision2Seq
- This error does not show when I use transformers 4.57.x but then I can't run this specific model.
0.4.11 gives:ImportError: cannot import name 'parse_eval_args' from 'lm_eval.__main__'
Please let me know if there is a solution yet, thanks!
In config.json:
"transformers_version": "5.0.0rc1"
Thanks, this is correct: you need a version of transformers>5.0.0. The model card has been updated to reflect this.