Commit History

  1. v4.0: Production-grade optimizations - priority queue, prefix caching, TTL, metrics, TTFT tracking Running

    Matrix Agent
    c9737d6
  2. v3.2: Speed optimizations - OpenBLAS, dual models (7B/1.5B), model selector, timing display

    Matrix Agent
    1b50d66
  3. Add frontend dashboard, comprehensive docs, and enhanced logging v3.1

    Matrix Agent
    8910367
  4. Fix asyncio event loop error in QueuedRequest dataclass

    Matrix Agent
    c5b1f8b
  5. Upload app.py with huggingface_hub

    Verified signature
    ab30b6f
  6. Upload app.py with huggingface_hub

    Verified signature
    9436565
  7. Upload folder using huggingface_hub

    Verified signature
    7ef800a
  8. Upload folder using huggingface_hub

    Verified signature
    9b2c0ff
  9. Upload app.py with huggingface_hub

    Verified signature
    2cd298a
  10. Upload app.py with huggingface_hub

    Verified signature
    c880d13
  11. Upload app.py with huggingface_hub

    Verified signature
    49560dc
  12. Upload requirements.txt with huggingface_hub

    Verified signature
    5654ea3
  13. Upload app.py with huggingface_hub

    Verified signature
    dffa5d7
  14. Upload Dockerfile with huggingface_hub

    Verified signature
    f09fb4b
  15. Upload README.md with huggingface_hub

    Verified signature
    7989a2d
  16. Upload requirements.txt with huggingface_hub

    Verified signature
    8e2f1db
  17. Upload app.py with huggingface_hub

    Verified signature
    b1751bb
  18. initial commit

    Verified signature
    dce0160