Zhi Wei Tan
zwtan-cs
ยท
AI & ML interests
Efficient LLM inference, KV cache optimization, quantization, speculative decoding, model pruning
Recent Activity
liked a dataset about 4 hours ago
open-llm-leaderboard-old/details_xformAI__opt-125m-gqa-ub-6-best-for-KV-cache liked a dataset about 4 hours ago
st192011/KVCaches liked a dataset about 4 hours ago
steven0226/speculative-decoding-bench-rtx4090Organizations
None yet