ai_api / docs /research /DISCOVERY_TOOL_DESIGN.md
Yogesh
initial deploy
cd8bd0a
|
Raw
History Blame Contribute Delete
5.33 kB

A newer version of the Gradio SDK is available: 6.24.0

Upgrade

Discovery Tool β€” Design Document

Status: Design + Stub (Phase 1) Related: Issue #2885

Overview

The Discovery Tool is an automated service that scans LLM providers for free/unlimited access methods, tests authentication bypasses, validates endpoints, and reports findings. It integrates into OmniRoute as an opt-in service (default off).

Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚           Discovery Service                  β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”‚
β”‚  β”‚ Scanner  β”‚  β”‚ Tester   β”‚  β”‚ Reporter β”‚  β”‚
β”‚  β”‚          β”‚  β”‚          β”‚  β”‚          β”‚  β”‚
β”‚  β”‚ - Probe  β”‚  β”‚ - Auth   β”‚  β”‚ - JSON   β”‚  β”‚
β”‚  β”‚   URLs   β”‚  β”‚   bypass β”‚  β”‚   report β”‚  β”‚
β”‚  β”‚ - Detect β”‚  β”‚ - Cookie β”‚  β”‚ - DB     β”‚  β”‚
β”‚  β”‚   APIs   β”‚  β”‚   extractβ”‚  β”‚   store  β”‚  β”‚
β”‚  β”‚ - Model  β”‚  β”‚ - Rate   β”‚  β”‚ - Notify β”‚  β”‚
β”‚  β”‚   disco  β”‚  β”‚   limits β”‚  β”‚          β”‚  β”‚
β”‚  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
         β”‚               β”‚               β”‚
         β–Ό               β–Ό               β–Ό
    Provider DB    Test Results    User Dashboard

Components

1. Scanner

  • Probes known provider URLs for API endpoints
  • Detects authentication requirements (none, cookie, API key, OAuth)
  • Discovers available models via /v1/models or equivalent
  • Checks for rate limits and free tier availability

2. Tester

  • Tests authentication bypass methods (cookie extraction, public endpoints)
  • Validates session token freshness
  • Measures rate limits and quotas
  • Tests streaming support

3. Reporter

  • Generates structured JSON reports
  • Stores findings in SQLite (discovery_results table)
  • Sends notifications for high-value discoveries
  • Updates provider registry suggestions

Configuration

interface DiscoveryConfig {
  enabled: boolean;           // Default: false (opt-in)
  scanInterval: number;       // ms between scans (default: 24h)
  maxConcurrentScans: number; // parallel scan limit (default: 3)
  targetProviders: string[];  // specific providers to scan (empty = all known)
  notificationWebhook?: string; // URL for discovery notifications
}

DB Schema

CREATE TABLE discovery_results (
  id INTEGER PRIMARY KEY AUTOINCREMENT,
  provider_id TEXT NOT NULL,
  method TEXT NOT NULL,           -- 'free_tier', 'web_cookie', 'auto_register', 'trial'
  endpoint TEXT,
  auth_type TEXT,                 -- 'none', 'cookie', 'api_key', 'oauth'
  models TEXT,                    -- JSON array of discovered models
  rate_limit TEXT,
  feasibility INTEGER,            -- 1-5 scale
  risk_level TEXT,                -- 'none', 'low', 'medium', 'high', 'critical'
  status TEXT DEFAULT 'pending',  -- 'pending', 'testing', 'verified', 'rejected'
  notes TEXT,
  discovered_at TEXT DEFAULT (datetime('now')),
  verified_at TEXT,
  UNIQUE(provider_id, method, endpoint)
);

API Endpoints

⚠️ Not yet implemented β€” Phase 2 (Future). The routes below are a design proposal, not live endpoints. src/lib/discovery/index.ts is an explicit Phase-1 stub and none of the discovery routes exist yet. They are intentionally documented here as the planned surface; the check-docs-symbols quality gate suppresses them via KNOWN_STALE_DOC_REFS until Phase 2 lands. See Implementation Plan β†’ Phase 2.

Method Path Description
GET /api/discovery/results List all discovery results
GET /api/discovery/results/:id Get specific result
POST /api/discovery/scan Trigger manual scan
POST /api/discovery/verify/:id Verify a discovery
DELETE /api/discovery/results/:id Delete a result

Settings Toggle

In OmniRoute dashboard settings:

{
  discovery: {
    enabled: false,           // Default off
    scanInterval: 86400000,   // 24 hours
    maxConcurrentScans: 3,
    targetProviders: [],
  }
}

Implementation Plan

Phase 1 (Current β€” Stub)

  • Design doc
  • Stub service (src/lib/discovery/index.ts)
  • DB migration for discovery_results table
  • Settings toggle in settings API
  • Basic scanner that probes a single URL

Phase 2 (Future)

  • Full scanner with multi-provider support
  • Auth bypass testing
  • Model discovery
  • Rate limit detection
  • Dashboard UI tab

Phase 3 (Future)

  • Auto-registration integration
  • Session pool management
  • Continuous scanning
  • Notification webhooks

Security Considerations

  • Discovery results may contain sensitive endpoint information
  • Cookie/session data should be encrypted at rest
  • Scan requests should respect rate limits to avoid IP bans
  • Results should be user-scoped (not shared across instances)