Methods for compressing the KV cache in transformer inference. E8 lattice, KVarN, TurboQuant, KIVI.
João André Gomes Marques
jmarquex
AI & ML interests
None yet
Recent Activity
updated a Space 1 day ago
jmarquex/nexusquant-demo updated a model 1 day ago
jmarquex/nexusquant updated a collection 7 days ago
KV Cache Compression MethodsOrganizations
None yet