transformer/lm-eval version compatibilty

#4
by ishanibasak - opened

Hello, could you share what versions are compatible with this model for lm-eval and transformers? After my on experimentation, I have found that transformers 4.57.x does not work with this model but 5.x does. So with this transformers version I have tested lm-eval 0.4.9.1 (which I had been using with other LFM2 models) and 0.4.11 (the most recent version) and neither of these work.

0.4.9.1 gives: AttributeError: module transformers has no attribute AutoModelForVision2Seq

  • This error does not show when I use transformers 4.57.x but then I can't run this specific model.
    0.4.11 gives: ImportError: cannot import name 'parse_eval_args' from 'lm_eval.__main__'

Please let me know if there is a solution yet, thanks!

In config.json:
"transformers_version": "5.0.0rc1"

Sign up or log in to comment