llm-api-proxy / src /proxy_app

Commit History

feat(api): ✨ add CORS middleware to allow cross-origin requests
30f6fec

Mirrowel commited on

docs: restructure project licensing documentation
89e4317

Mirrowel commited on

feat(client): enhance streaming error handling and log clarity
856f4f3

Mirrowel commited on

Fix(logging): enhance logging configuration and control
83934f3

Mirrowel commited on

perf(litellm): improve litellm operational efficiency
aa25dd9

Mirrowel commited on

feat(logging): centralize and enhance application logging
4caa52c

Mirrowel commited on

feat(rotator): allow explicit logging configuration for client
15c96ab

Mirrowel commited on

feat: Improve streaming error handling and refactor client completions
231840d

Mirrowel commited on

fix: Await response generator in chat completions for proper streaming
45e5783

Mirrowel commited on

Refactor: Streaming response handling and key management.
3f958d9

Mirrowel commited on

feat: Improve streaming robustness and key management
b5b51f2

Mirrowel commited on

feat: Abort API retries on client disconnection
978e4a8

Mirrowel commited on

fix(client): centralize model parameter conversion
2fdaebd

Mirrowel commited on

feat(embeddings): Make server-side batching optional
654f0fe

Mirrowel commited on

feat(embeddings): Implement request batching for performance
1337d48

Mirrowel commited on

feat(embeddings): Allow string input and update Pydantic calls
304ae92

Mirrowel commited on

feat(proxy): Add granular litellm exception handling
6b6277b

Mirrowel commited on

feat: Add support for embeddings endpoint
64e385a

Mirrowel commited on

refactor: Reconstruct complete response from stream for logging
7c98724

Mirrowel commited on

feat: Add CLI args, lazy loading, and enhance Gemini provider
1e530bb

github-actions[bot] commited on

feat: Add release drafter configuration and refactor build process to use Python script
197b66d

Mirrowel commited on

feat: Add build workflow, proxy application, and update documentation for executable usage
5bfdc95

Mirrowel commited on

feat: Enhance request logging to ensure proper UTF-8 encoding in log files
0374254

Mirrowel commited on

feat: Implement request logging for API responses and enhance streaming response handling
54f0f2c

Mirrowel commited on

feat: update proxy to use the new async context management
72525d5

Mirrowel commited on

feat: Exclude PROXY_API_KEY from provider API key loading and enhance model retrieval options
26c6a6e

Mirrowel commited on

feat(multi-provider): Implement dynamic API key loading and new endpoints
21dcb11

Mirrowel commited on

feat: Refactor project into reusable API key rotation library and proxy
79a70b2

Mirrowel commited on

feat: Implement robust API key rotation, retry, and logging
aea7b14

Mirrowel commited on

Inital commit
bf565ba

Mirrowel commited on