How to use CMB-AI-LAB/lagkv_cache with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("CMB-AI-LAB/lagkv_cache", device_map="auto")
