Fix: Handle cache_position argument for newer Transformers

by Todokete - opened Apr 19, 2025

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

-1

Todokete

Apr 19, 2025

Fixes "TypeError: MixsenseLlamaForCausalLM.forward() got an unexpected keyword argument 'cache_position'" in newer Transformers releases by adding cache_position to the forward and prepare_inputs_for_generation method signatures and passing it to the super() calls.

Fix: Handle cache_position argument for newer Transformersa044327e

ZeroVision-rxxiang changed pull request status to merged Apr 21, 2025

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment