koreallmdev's picture
Combined local Ollama runtime and Router API v4.1 sanitized upload
53023f4 verified
|
Raw
History Blame Contribute Delete
666 Bytes

Qwen3 Docker OpenWebUI + Ollama + Router Stack

์ด stack์€ ๊ธฐ์กด Open WebUI ์ปจํ…Œ์ด๋„ˆ๋ฅผ ๊ฑด๋“œ๋ฆฌ์ง€ ์•Š๊ณ  ์ƒˆ๋กœ ๋„์›๋‹ˆ๋‹ค.

์ฃผ์†Œ:

Open WebUI: http://127.0.0.1:3001
Ollama API: http://127.0.0.1:11435
Router API: http://127.0.0.1:8011/v1

๊ตฌ์„ฑ:

open-webui -> ollama:11434
open-webui -> router-api:8011/v1
router-api -> ollama:11434

Open WebUI ์•ˆ์—์„œ๋Š” ๋‘ ๊ฐ€์ง€๊ฐ€ ๋ณด์ผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Ollama static model:
qwen3-8b-korean-coding-router:latest

OpenAI-compatible router model:
qwen3-8b-korean-coding-router

full router/post-check/longform ๊ธฐ๋Šฅ์€ router-api ๊ฒฝ์œ  ๋ชจ๋ธ์—์„œ ๋™์ž‘ํ•ฉ๋‹ˆ๋‹ค.