llm-api-proxy / src /proxy_app /batch_manager.py

Commit History

feat(embeddings): Implement request batching for performance
1337d48

Mirrowel commited on