Ruslan S.

Hi, @jzx03 ,
I am not aware of any of the related code being broken right now, but Transformers is big and fast growing library, and such things happened before. It would be best if you post a reproducible example as an issue, showing difference in behavior in 4.49 and some earlier version. See how I did that in https://github.com/huggingface/transformers/issues/29525.
Also check the relevant tests like https://github.com/huggingface/transformers/blob/be37d34f44ff1bc928e59ffb8a30adecab8835a8/tests/models/llama/test_modeling_llama.py#L811 see if they still work OK, or, possibly extend the tests to cover the failure that you discovered.

no, I don't have such script readily available. please follow the links in section 2 above or search elsewhere