Fix create_causal_mask kwarg: input_embeds -> inputs_embeds

#13

by maximilian-schall-ppx - opened Jun 2

base: refs/heads/main

←

from: refs/pr/13

Discussion Files changed

+23

-14

Fix create_causal_mask kwarg: input_embeds -> inputs_embeds0d6f110e

maximilian-schall-ppx

Perplexity org Jun 2

The current modeling.py calls create_causal_mask(input_embeds=...) (singular). The transformers API expects inputs_embeds= (plural). On transformers 5.9 this raises:

TypeError: create_causal_mask() got an unexpected keyword argument 'input_embeds'

Reference: transformers/masking_utils.py defines create_causal_mask(config, inputs_embeds, ...).

Reproduced on transformers 5.9.0 (fails) and 5.8.0 (works) prior to this change.

Drop cache_position kwarg (removed from create_causal_mask in transformers 5.9)b9efc29d

Make cache_position kwarg conditional on transformers versionb957c071

Also detect input_embeds vs inputs_embeds kwarg namef8e73620

maximilian-schall-ppx changed pull request status to merged Jun 2

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment