--- library_name: ollama base_model: Qwen/Qwen3-8B language: - ko - en tags: - ollama - open-webui - docker - qwen3 - korean - coding - router - runtime-package license: other pipeline_tag: text-generation --- # Qwen3 8B Korean Coding Router - Combined Local + Router Runtime ## 한국어 설명 Qwen3-8B를 Ollama에서 불러오고, 우리가 만든 Router API v4.1과 Open WebUI Docker stack을 결합한 한국어 코딩/운영 보조 런타임 배포판입니다. ## English Summary Qwen3-8B based Korean coding/ops runtime package for Ollama, Open WebUI, and Docker Router API v4.1. Includes local Ollama runtime and router stack; model weights are not included. ## Stable Release ```text STABLE_LOCKED_VERSION=v4.1 ROUTER_API=Qwen3RouterAPI/4.1 ROUTING=priority_intent_router_v4_1 HF_REPO=koreallmdev/qwen3-8b-korean-coding-router ``` This repository combines two local runtime layers: 1. `local_ollama_runtime/` Local Ollama package with Modelfile, terminal wrapper, smoke scripts, policies, and reports. 2. `docker_openwebui_router_stack/` Docker Open WebUI + Ollama + Router API stack with the v4.1 priority intent router. This repository is **not** a full Hugging Face model checkpoint and does **not** include Qwen3 base weights. Stable version: ```text v4.1 combined local + router runtime snapshot=20260711_234506 ``` ## Required base model ```bash ollama pull qwen3:8b ``` ## Option A: Docker Open WebUI + Router API ```bash cd docker_openwebui_router_stack bash start_stack.sh bash create_ollama_model.sh bash smoke_stack.sh ``` Open WebUI: ```text http://127.0.0.1:3001 ``` Recommended model in Open WebUI: ```text qwen3-8b-korean-coding-router ``` Router API: ```text http://127.0.0.1:8011/v1 ``` Ollama API exposed to host: ```text http://127.0.0.1:11435 ``` Internal Docker addresses: ```text Open WebUI -> Ollama = http://ollama:11434 Open WebUI -> Router API = http://router-api:8011/v1 Router API -> Ollama = http://ollama:11434 ``` The local OpenAI-compatible API key used by the Docker stack is a non-secret placeholder: ```text local ``` ## Option B: Local Ollama terminal/runtime package ```bash cd local_ollama_runtime bash create_ollama_model.sh bash run_ollama_router_chat.sh ``` Static Ollama model: ```text qwen3-8b-korean-coding-router:latest ``` ## Quick run from repo root Docker stack: ```bash bash run_docker_router_stack.sh ``` Local Ollama terminal runtime: ```bash bash run_local_ollama_runtime.sh ``` ## v4.1 router behavior ```text priority_intent_router_v4_1 route/debug endpoint port/PID safety guard Docker/Open WebUI stack URL guard longform-context misroute prevention history trimming for long answers ``` For port/PID questions, the router enforces: ```text 확인 전에는 kill하지 않습니다. ss -lntp ps kill -9는 마지막 수단입니다. ``` For current Docker/Open WebUI stack questions, the router prioritizes: ```text http://ollama:11434 http://router-api:8011/v1 http://127.0.0.1:3001 ``` and avoids old host bridge answers such as: ```text host.docker.internal:11434 172.17.0.1:11434 ``` ## Important notice Do not load this repository with: ```python AutoModelForCausalLM.from_pretrained("koreallmdev/qwen3-8b-korean-coding-router") ``` This repository is a runtime package, not a model checkpoint.