Fix: enumerate typo and sliding_window key name in modeling_trillion.py

by AeonProtocol - opened Mar 17

base: refs/heads/main

←

from: refs/pr/4

Discussion Files changed

-2

AeonProtocol

Mar 17

Two bug fixes in modeling_trillion.py:

enumrate → enumerate (NameError during forward pass)
"sliding_window" → "sliding_attention" (KeyError in causal_mask_mapping)

These bugs cause crashes when running the model with output_attentions=True or during LoRA fine-tuning. Discovered during cooperative basin research experiments.

Fix: enumerate typo and sliding_window key name in modeling_trillion.pyb013930b

WonsukYangTL changed pull request status to merged Mar 17

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment