harshithsaiv
/

kv-cache-compression

memory-efficient

inference-optimization

4-bit precision

mixed-precision

Model card Files Files and versions

kv-cache-compression / benchmark_long_context.py

Commit History

feat: complete 4-method benchmark with honest memory reporting

0774ec2

harshithsaiv commited on 4 days ago

feat: adding benchmark for longer context

1a0124b

harshithsaiv commited on 4 days ago