Spaces:
Running
Running
Commit History
-
Add Cerebras, Silicon Flow, and Groq providers with debug logging.
- Added Groq provider with model ID mapping - Added debug logging to trace API key and model issues - Silicon Flow base URL changed from .cn to .com - Cerebras rate limits increased to 300/80 Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>db83b53
-
$(cat <<EOF
Add Groq provider support with ultra-fast inference models. Groq API key validated and working. Models added: - groq/llama-3.3-70b-versatile (fast, 70B reasoning) - groq/llama-3.1-8b-instant (fastest, 8B general) - groq/qwen3-32b (fast, reasoning capable) Files modified: - config/provider_catalog.py: Added GROQ_DEFAULT_BASE and groq provider descriptor - providers/defaults.py: Re-export GROQ_DEFAULT_BASE - config/settings.py: Added groq_api_key and provider_is_configured check - providers/registry.py: Added _create_groq factory - providers/groq/client.py: New provider client - providers/groq/__init__.py: New provider init - core/model_capabilities.py: Registered groq models - api/routes.py: Added groq models to REQUESTED_PROVIDER_MODELS - .env: Added GROQ_API_KEY Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> EOF )98fdd46 -
$(cat <<EOF
Fix Silicon Flow base URL from .cn to .com domain. Silicon Flow API key only works with api.siliconflow.com, not .cn. Also added silicon_api_key to .env for testing. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com> EOF )55f294b -
Add Cerebras and Silicon Flow provider support
- Cerebras: qwen/qwen-3-235b-a22b-instruct-2507 (Qwen 3 235B) - Silicon Flow: Qwen3.6-35B/27B, Qwen3.5-35B/27B (VLM multimodal), Gemma-4-26B/31B reasoning models - Both use OpenAI-compatible /chat/completions via OpenAIChatTransport - API keys: CEREBRAS_API_KEY, SILICON_API_KEY Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>43ea069 -
Extend session visibility in admin dashboard with configurable retention
- Add retention_seconds param to SessionTracker (default 30min) - Sessions now stay visible 30min after last request instead of 2min - Add SESSION_RETENTION_MINUTES env var for configuration - Show Active/Idle status in admin UI (<5min vs >5min idle) Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>6339a53 -
Implement image support in proxy with vision-aware routing
- Add Anthropic→OpenAI image block conversion with size validation - Update ModelCapabilities with granular vision support fields - Support base64-encoded images with memory optimization - Add 20MB image size limit guard in conversion - Clear base64 data from request blocks to reduce memory footprint - Update mistral-large-3-675b model entry with vision capabilities - Enable vision-aware model routing for image requests Closes: image upload support in Claude Code proxy Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>574e4e7 -
NIM speed optimization — adaptive rate limiting and increased throughput
- Add AdaptiveRateLimiter with auto-backoff on 429s (starts at 100 req/min, backs off to 10, recovers gradually) - Increase NIM rate limit to 100 req/min with 40 max concurrency (configurable via NIM_RATE_LIMIT, NIM_MAX_CONCURRENCY) - Tighten NIM timeouts: connect=8s, first_chunk=20s, fallback_first_chunk=12s - Lock-free fast path in StrictSlidingWindowLimiter (reduces contention under load) - Faster retry delays: base=0.3s, max=20s, jitter=0.1s - Max out HTTP connection pool: 100 keepalive, 500 connections, 5s expiry - Aggressive HTTP pool warmup on startup (forces TCP+TLS connection establishment) - Record 429s to ModelHealthTracker for adaptive recovery - Update CLAUDE.md with per-provider health params and session cleanup notes Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>aa9c0b0
-
Fix: sessions tracking now works correctly in dashboard and JSON
- Added `track_request` calls in services.py for both single-model and fallback paths - Sessions now show in `/admin` and `/api/admin/sessions` - Added `/` root endpoint to show active sessions count Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>ef123a8 -
Remove groq from provider catalog
af4fba5 -
Deploy claude-code-nvidia proxy to Hugging Face Spaces
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>0157ac7