EXDai's picture
Upload README.md with huggingface_hub
f9941ed verified
|
Raw
History Blame Contribute Delete
351 Bytes
---
title: LLM Inference Simulator Extended
emoji: 🚀
colorFrom: gray
colorTo: purple
sdk: static
pinned: false
---
# LLM Inference — Pipeline Simulator v2
Extended version with concurrency, batching, prefix caching. From EXD Episode 4.
📺 [YouTube Channel](https://youtube.com/@EXD-ai) | 💻 [GitHub](https://github.com/Ramshreyas/EXD)