Instructions to use JunlongTong/StreamingLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use JunlongTong/StreamingLLM with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("JunlongTong/StreamingLLM", dtype="auto") - Notebooks
- Google Colab
- Kaggle
File size: 132 Bytes
56d73fa | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:db2ef84990688151c3536526ef2107e90f542517345034598d268155a44bab2d
size 1629018
|