qwen3-4b-cpu / README.md
Nomos42's picture
touch: force rebuild 2026-04-17T20:50:23.682702Z
2f442c5 verified
|
Raw
History Blame Contribute Delete
572 Bytes
---
title: Nomos42 Qwen3-4B Instruct CPU
emoji: 🐋
colorFrom: purple
colorTo: blue
sdk: docker
app_port: 7860
pinned: false
hardware: cpu-basic
license: apache-2.0
---
# Nomos42 Qwen3-4B-Instruct CPU
OpenAI-compatible inference for **Qwen3-4B-Instruct-2507** (GGUF Q4_K_M, ~2.5 GB).
Released 2026-04-09, ranked #1 quality/size on free 16 GB CPU tier.
Benchmarks: MMLU-Redux 83.1 · MMLU-Pro 61.4 · IFEval 69.5
- `GET /``{model, ready, ...}`
- `POST /v1/chat/completions` (OpenAI schema)
- `POST /chat/completions`
<!-- touch: 2026-04-17T20:50:23.682702Z -->