transformers-community
/

sink_cache

custom_generate

Model card Files Files and versions

sink_cache / custom_generate

Commit History

Fix SinkCache RoPE coordinates for absolute generation

5382829
verified

jholl-hugging commited on 13 days ago

add sanity checks

835a8a6

Joao Gante commited on May 22, 2025

add sanity checks

ffa8b5a

Joao Gante commited on May 22, 2025

allow passing a sink cache back in

f84586a

Joao Gante commited on May 22, 2025

add sink cache options

e9837c5

Joao Gante commited on May 22, 2025

add sinkcache class

7f36015

Joao Gante commited on May 22, 2025