aio-llm / README.md
OrganatAdminIT's picture
fix: replace Ollama with LiteLLM forward proxy — startup <15s
a83870b verified
metadata
title: organatadminit-aio-llm
emoji: 🤖
colorFrom: blue
colorTo: purple
sdk: docker
app_port: 7860
pinned: false

organatadminit-aio-llm

LiteLLM Forward Proxy — routes /v1/* requests to organatceo inference nodes.

Primary: organatceo-aio-llm.hf.space
Fallback: organathf3-aio-llm.hf.space

Startup: ~15 seconds (no model download required)