model-gateway-api / service.py

Commit History

✨ Implement lazy loading for models and correct tokens counting
e4b3020

autumnssuns commited on

✨ Add Gemma 4 E2B model integration and update service to support multiple models
21bfda5

autumnssuns commited on

✨ Implement model gateway with Llama model integration and /generate API endpoint
6efef64

autumnssuns commited on