Update rope embeddings for rope_type='default'
#3
by
sirorezka - opened
This is needed in accordance with transformers>=v5.0. In Transformers v5.0 and higher "default" is excluded from dictionary ROPE_INIT_FUNCTIONS and harcoded individually for each model.
ridger changed pull request status to
merged