from transformers.modeling_utils import no_init_weights does not seem to work anymore in transformers 5.0.1.dev0. I tried from transformers.initialization import no_init_weights and that seems to work.

On older versions of transformers, your new import statement does not work. So I think it will be best if you add a comment explaining which import line to use for which version.

On older versions of transformers, your new import statement does not work. So I think it will be best if you add a comment explaining which import line to use for which version.

Ok I've updated it to be a bit more helpful.

mingyi456 changed pull request status to merged

Sign up or log in to comment