llm-api-proxy / src /rotator_library /usage_manager.py

Commit History

refactor(quota-viewer): πŸ”¨ enhance credential sorting and cooldown display
1af1879

Mirrowel commited on

refactor(usage): πŸ”¨ sync request_count across quota group models
1ac7bd0

Mirrowel commited on

feat(usage): ✨ use request count for credential selection when failed requests consume quota
48b6b15

Mirrowel commited on

feat(quota-viewer): ✨ add quota and usage statistics viewer system
8b4ff52

Mirrowel commited on

feat(antigravity): ✨ add credential availability tracking for models
818ba14

Mirrowel commited on

feat(antigravity): ✨ add quota tracking with independent background jobs
2be7535

Mirrowel commited on

refactor(core): πŸ”¨ centralize path management for PyInstaller compatibility
467f294

Mirrowel commited on

feat(io): ✨ add fault-tolerant file operations with automatic recovery
7f148b3

Mirrowel commited on

Merge origin/main into feat/runtime-resilience - Resolve conflict in usage_manager.py by integrating runtime resilience with human-readable timestamps
01932f9

Mirrowel commited on

feat(concurrency): ✨ add priority-based concurrency multipliers for credential tiers
aefb706

Mirrowel commited on

feat(usage): ✨ add human-readable timestamp fields to usage data for debugging
4cdd261

Mirrowel commited on

fix(resilience): complete circuit breaker patterns per PR review
5e42536

MasuRii commited on

feat: add runtime resilience for file deletion survival
31c3d36

MasuRii commited on

refactor(usage): πŸ”¨ cache provider plugin instances to reduce redundant instantiation
fd01482

Mirrowel commited on

feat(usage): ✨ implement per-model quota tracking with authoritative reset timestamps
0ca1651

Mirrowel commited on

feat(usage): ✨ add provider-specific rolling window usage tracking
98f6823

Mirrowel commited on

feat(rotation): ✨ add sequential rotation mode with provider-specific quota parsing
bd84d38

Mirrowel commited on

feat(providers): ✨ implement credential tier initialization and persistence system
4dfb828

Mirrowel commited on

Merge branch 'Antigravity' of https://github.com/Mirrowel/LLM-API-Key-Proxy into fix/quota-exceeded-global-cooldown
5a29725

MasuRii commited on

fix(rotator): prevent quota errors from global cooldown
0dd6d21

MasuRii commited on

fix(logging): preserve full credential filenames in logs
fce1762

MasuRii commited on

feat(rotation): ✨ add configurable weighted random credential selection
f35e0e7

Mirrowel commited on

feat(client): ✨ add credential prioritization system for tier-based model access
b5da45c

Mirrowel commited on

fix(auth): πŸ”¨ tighten oauth refresh intervals, expand refresh buffers, improve logging and add iFlow docs
abbdf2a

Mirrowel commited on

fix(core): improve error classification and prevent false key penalization
20944a5

Mirrowel commited on

feat(core): enable configuration of maximum concurrent requests per key
79e83ae

Mirrowel commited on

refactor(core): πŸ”¨ use static class attribute for provider skipping flag
3962356

Mirrowel commited on

feat(core): enable static model configuration and LiteLLM compatibility for custom providers
39e01ca

Mirrowel commited on

refactor(core): review fixes + improve error handling and execution logic
19af906

Mirrowel commited on

fix(core): stabilize streaming for custom providers and refine usage recording
79c9227

Mirrowel commited on

fix(core): stabilize streaming for custom endpoints and eliminate initialization conflicts
63418af

Mirrowel commited on

refactor: improve model registration and usage manager robustness
0a3b5b1

Mirrowel commited on

fix(usage): initialize daily reset for new usage keys
c036ceb

Mirrowel commited on

refactor(rotator): randomize key selection and streamline daily stats reset
aaab6f8

Mirrowel commited on

feat(core): implement deadline-driven request execution and resilient error handling
62ed41b

Mirrowel commited on

Fix(logging): enhance logging configuration and control
83934f3

Mirrowel commited on

perf(rotator): prevent indefinite waits for API key acquisition
f8d59cd

Mirrowel commited on

fix: Type import oopsie
065b08b

Mirrowel commited on

feat: Add support for embeddings endpoint
64e385a

Mirrowel commited on

feat: Handle API errors within streams and record usage
dbb8b44

Mirrowel commited on

refactor: Remove file locking mechanism from usage data saving
1faf5c2

Mirrowel commited on

feat: Enhance daily reset logic to ensure timezone-aware date handling
33e95e6

Mirrowel commited on

fix: Handle missing cooldown values in UsageManager to prevent key lockout type errors
5fb237f

Mirrowel commited on

feat: Update key release logic in RotatingClient and UsageManager to support model-specific tracking
bab8bf0

Mirrowel commited on

feat: Enhance error classification and handling in UsageManager and error_handler for improved retry logic and cooldown management
27b342a

Mirrowel commited on

feat: Enhance asynchronous handling in RotatingClient and UsageManager for improved error management and usage tracking
4bbfff4

Mirrowel commited on

feat: Improve key acquisition logic in RotatingClient and UsageManager for better async handling and error management
aa8035e

Mirrowel commited on

feat: Enhance error handling in UsageManager to extract retry delay from multiple error message formats
bf79e30

Mirrowel commited on

feat: Refactor logging to use a dedicated logger across providers and enhance model retrieval with httpx
d51ae99

Mirrowel commited on

feat: Implement per-model API key cooldowns
c2eea0c

Mirrowel commited on