harshithsaiv
/

kv-cache-compression

memory-efficient

inference-optimization

4-bit precision

mixed-precision

Model card Files Files and versions

kv-cache-compression

File size: 131 Bytes

598ef59

version https://git-lfs.github.com/spec/v1
oid sha256:42ae52641b7ed339289c5e80eae20fbb47cd16c84c873a7d0055b4fcc04a982b
size 116907