Spaces:

amarshiv86
/

p11-streaming

Paused

Upload folder using huggingface_hub

478b2e5 verified about 1 month ago

396 Bytes

A newer version of the Gradio SDK is available: 6.20.0

title: P11 Streaming LLM API
emoji: ⚡
colorFrom: yellow
colorTo: green
sdk: gradio
sdk_version: 5.29.0
app_file: app.py
pinned: false

P11 · Streaming LLM API + Real-time UX

Token-by-token streaming with TTFT tracking, cancellation, and rate limiting. Part of the Staff SRE · AI Engineer Portfolio.

Model runs locally — no external API calls.