Inference Engineering Academy

inference-engineering-academy's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

updated a collection 1 day ago

LLM Inference Engineering: notes & tools

Collection

Worked-math notes on KV cache, prefill/decode, batching, quantization, serving engines + KV-cache calculator. Free course: inference-engineering.xyz • 2 items • Updated 1 day ago

updated a Space 9 days ago

Running

LLM KV Cache & GPU Memory Calculator

🧮

KV cache size, weights and max batch for LLM serving

published a Space 9 days ago

Running

LLM KV Cache & GPU Memory Calculator

🧮

KV cache size, weights and max batch for LLM serving

updated a dataset 9 days ago

inference-engineering-academy/llm-inference-notes

Updated 9 days ago • 48

published a dataset 9 days ago

inference-engineering-academy/llm-inference-notes

Updated 9 days ago • 48