Zhi Wei Tan
zwtan-cs
ยท
AI & ML interests
Efficient LLM inference, KV cache optimization, quantization, speculative decoding, model pruning
Recent Activity
liked a dataset 14 minutes ago
open-llm-leaderboard-old/details_xformAI__opt-125m-gqa-ub-6-best-for-KV-cache liked a dataset 15 minutes ago
st192011/KVCaches liked a dataset 15 minutes ago
steven0226/speculative-decoding-bench-rtx4090Organizations
None yet