Instructions to use transformers-community/sink_cache with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use transformers-community/sink_cache with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("transformers-community/sink_cache", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
example ea681c7
Joao Gante commited on
revert readme bd36a6b
Joao Gante commited on
add model 7939f4e
Joao Gante commited on
add example d938814
Joao Gante commited on
update readme bdb93c2
Joao Gante commited on
add WIP 2a0ad2b
Joao Gante commited on
add sanity checks 835a8a6
Joao Gante commited on
add sanity checks ffa8b5a
Joao Gante commited on
allow passing a sink cache back in f84586a
Joao Gante commited on
add sink cache options e9837c5
Joao Gante commited on
add sinkcache class 7f36015
Joao Gante commited on
add readme 7bbd1e8
Joao Gante commited on