v4.0: Production-grade optimizations - priority queue, prefix caching, TTL, metrics, TTFT tracking

v3.2: Speed optimizations - OpenBLAS, dual models (7B/1.5B), model selector, timing display

Add frontend dashboard, comprehensive docs, and enhanced logging v3.1

Fix asyncio event loop error in QueuedRequest dataclass

Upload app.py with huggingface_hub

Upload app.py with huggingface_hub

Upload folder using huggingface_hub

Upload folder using huggingface_hub

Upload app.py with huggingface_hub

Upload app.py with huggingface_hub

Upload app.py with huggingface_hub

Upload requirements.txt with huggingface_hub

Upload app.py with huggingface_hub

Upload Dockerfile with huggingface_hub

Upload README.md with huggingface_hub

Upload requirements.txt with huggingface_hub

Upload app.py with huggingface_hub

initial commit