Spaces:

EXDai
/

inference-simulator-v2

Running

Upload README.md with huggingface_hub

f9941ed verified 17 days ago

351 Bytes

title: LLM Inference Simulator — Extended
emoji: 🚀
colorFrom: gray
colorTo: purple
sdk: static
pinned: false

LLM Inference — Pipeline Simulator v2

Extended version with concurrency, batching, prefix caching. From EXD Episode 4.