batistado/CoherenceBench-Agent
Viewer • Updated • 1.47k • 61
How to use batistado/MESI-KV with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("batistado/MESI-KV", device_map="auto")MESI-KV_IEEE_TPDS_Preprint.pdfbatistado/CoherenceBench-Agentbatistado/MESI-KV-Explorergithub.com/batistado/mesikvWhen external files, configs, or database rows mutate mid-trajectory, unmodified CausalLM caches fail silently—either keeping stale memoized Value (V) vectors (Leyline / PatchKV) or flushing 100% of downstream KV blocks (Concord). MESI-KV tracks Python AST symbol, config key, and SQLite row-version granules in a 4-state (S, M, T, I) Lease Directory, accumulates Order-Statistic Calibrated Attention Taint in FP32 pre-scaled chunks, and surgically recomputes only mutated + tainted downstream blocks while rotating clean suffix blocks via closed-form $SO(2)$ relative RoPE shifts $R_\Delta$.
pip install git+https://github.com/batistado/mesikv.git
@article{syed2026mesikv,
title = {{MESI-KV}: Cross-Layer Directory Coherence and Attention-Taint-Bounded Invalidation Across Mutable Workspaces, Semantic Tool Caches, and Disaggregated {KV} Pools},
author = {Syed, Mohammed Kamran and Rentala, Anudeep and Rahul, Somesh and Pai, Raghuram Malpe and Dara, Krishna Suman},
journal = {IEEE Transactions on Parallel and Distributed Systems (TPDS)},
year = {2026},
url = {https://github.com/batistado/mesikv}
}