Fix modeling_nemotron_h.py

#28

by rrs1616 - opened Oct 3, 2025

base: refs/heads/main

←

from: refs/pr/28

Discussion Files changed

+27

-16

rrs1616

Oct 3, 2025

modeling_nemotron_h.py is incompatible with the newer DynamicCache API in transformers that changed key_cache to a read-only property. This patch fixes it by using the new cache API (cache.layers[idx].keys instead of cache.key_cache)

Fix modeling_nemotron_h.pya21d8b44

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment