InsuranceBot / backend /providers /__init__.py
rohitsar567's picture
chore(cleanup): purge stale narrative/tombstones/dead code β€” codebase reads as the current standard
23b8fad
Raw
History Blame Contribute Delete
895 Bytes
"""Provider clients β€” thin, async, behind a common interface.
The provider stack:
sarvam_stt.py β€” Sarvam Saarika v2.5 (speech-to-text)
sarvam_tts.py β€” Sarvam Bulbul v2 (text-to-speech, speaker anushka)
sarvam_llm.py β€” Sarvam-M (Indic translation IN and OUT; not brain)
local_embeddings.py β€” BGE-small-en-v1.5 (local CPU embeddings)
nvidia_nim_llm.py β€” Chain pattern via NimChainLLM. BRAIN_CHAIN is the
only chain: Qwen 3-Next 80B β†’ Mistral Large 3
675B β†’ Llama-4 Maverick 17B β†’ Nemotron-Super 49B
(last resort).
openrouter_llm.py β€” OpenRouter client (cross-provider option).
groq_llm.py β€” Groq LPU client.
All clients are async (use httpx.AsyncClient) so the FastAPI handlers can
parallelize provider calls without blocking the event loop.
"""