Instructions to use Jackrong/Qwopus3-5-9B-Coder-Flash with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Jackrong/Qwopus3-5-9B-Coder-Flash with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="Jackrong/Qwopus3-5-9B-Coder-Flash") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Jackrong/Qwopus3-5-9B-Coder-Flash") model = AutoModelForMultimodalLM.from_pretrained("Jackrong/Qwopus3-5-9B-Coder-Flash", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Jackrong/Qwopus3-5-9B-Coder-Flash with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Jackrong/Qwopus3-5-9B-Coder-Flash" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jackrong/Qwopus3-5-9B-Coder-Flash", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/Jackrong/Qwopus3-5-9B-Coder-Flash
- SGLang
How to use Jackrong/Qwopus3-5-9B-Coder-Flash with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Jackrong/Qwopus3-5-9B-Coder-Flash" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jackrong/Qwopus3-5-9B-Coder-Flash", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Jackrong/Qwopus3-5-9B-Coder-Flash" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Jackrong/Qwopus3-5-9B-Coder-Flash", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Unsloth Desktop
- Docker Model Runner
How to use Jackrong/Qwopus3-5-9B-Coder-Flash with Docker Model Runner:
docker model run hf.co/Jackrong/Qwopus3-5-9B-Coder-Flash
- ⚡️Qwopus3.5-9B-Coder-Flash
- 💡 1. The Flash Philosophy — Make Each Token Count
- 🧪 2. Model Preparation and Collaboration
- 📊 3. Coding Quality — HumanEval and HumanEval+
- ⚡ 4. Efficiency — Shorter Reasoning, More Useful Code
- 🍎 5. Practical Agent Evaluation — BenchLocal
- 🧭 6. Intended Use and Limitations
- 🙏 7. Acknowledgements and Citation
- 💡 1. The Flash Philosophy — Make Each Token Count
⚡️Qwopus3.5-9B-Coder-Flash
Qwopus3.5-9B-Coder-Flash is a coding and agent-focused fine-tune of Qwen3.5-9B, prepared from the Unsloth distribution. This repository provides the merged dense checkpoint. The benchmarks below evaluate the release checkpoint.
💡 1. The Flash Philosophy — Make Each Token Count
A small model should make useful work accessible on local hardware. Following the efficiency-first philosophy of Qwopus3.8-27B-Flash-V2, Coder Flash aims to preserve practical problem-solving ability while reducing unproductive reasoning.
This matters especially in an agent loop: read → reason → call tools → edit → test. A little extra thinking on every turn accumulates into a long wait. The goal is focused reasoning that reaches usable code and a clear next action, with less generation overhead.
Efficiency includes correctness. A shorter answer is valuable when it still solves the task. The results below pair coding quality with measured reasoning length, rather than treating brevity alone as success.
🧪 2. Model Preparation and Collaboration
Built with community support. Special thanks to Kyle Hessling · @KyleHessling1 on X for his collaboration, test, feedback, and machine support for the Qwopus project, and to Unsloth for making efficient fine-tuning more accessible. Explore the Unsloth framework on GitHub.
📊 3. Coding Quality — HumanEval and HumanEval+
Both models were evaluated on HumanEval+ v0.1.10, with 164 programming tasks, five samples per task, and 820 generations per model. The reported configuration uses temperature 0.2, top-p 0.95, Q8_0 GGUF, llama.cpp CUDA, and MTP speculative decoding with maximum draft length 2.
On the expanded HumanEval+ diagnostic scores, Coder Flash produced 63 more correct samples, a 9.56% relative increase, with a 7.68 percentage-point gain in Pass@1. Here, Pass@1 is estimated from all five samples per task; Pass@5 measures the probability that at least one of the five samples passes.
Run-configuration differences are described in the efficiency section below.
⚡ 4. Efficiency — Shorter Reasoning, More Useful Code
Across 820 generations per model, Qwen3.5-9B averaged 4,189.07 reasoning tokens, compared with 885.31 tokens for Coder Flash — a 78.87% reduction, or approximately 3,304 fewer tokens per attempt. Coder Flash also produced 63 more correct HumanEval+ samples.
Reasoning lengths were calculated from the saved evaluation outputs, including the recorded reasoning_content.
More useful code with less reasoning. Correct HumanEval+ samples per 1,000 reasoning tokens increased from 0.192 to 0.995, giving Coder Flash 5.18× the reasoning efficiency.
Median chain-of-thought length decreased from 727.5 to 398 tokens, while the 95th percentile decreased from 15,360 to 2,586 tokens.
Reasoning-length variance decreased by 85.76% overall and 85.22% across repeated attempts on the same task.
🍎 5. Practical Agent Evaluation — BenchLocal
We evaluated Coder Flash and Qwen3.5-9B with BenchLocal to compare their performance on local agent tasks.
Test environment: Apple Silicon Mac, LM Studio.
Coder Flash achieved higher overall scores in both suites:
The following breakdown compares performance across selected capabilities:
Scores are BenchLocal composite scores. Docker-based verification was unavailable during these runs.
Thank you to Steven Lei (stevenlei) for creating BenchLocal.
🧭 6. Intended Use and Limitations
Coder Flash is intended for local code generation, debugging, tool-assisted development, and experimentation with compact agents. Review generated code and run your own tests before relying on it.
The reported results cover specific tasks, prompts, sampling settings, and runtimes. They do not establish universal coding accuracy, vision quality, long-context reliability, or agent safety. Reasoning-length variability measures generation behavior, not the probability of a correct answer. Difficult tasks can still produce errors, inefficient reasoning, or unsuccessful tool interactions.
🙏 7. Acknowledgements and Citation
Thanks to the Qwen team for the foundation model; Unsloth and its open-source framework for fine-tuning tooling; Kyle Hessling for Qwopus collaboration and support; EvalPlus, llama.cpp, LM Studio, MLX, and BenchLocal for the evaluation and local inference ecosystem.
License: Apache-2.0, following the upstream model license.
@misc{jackrong2026qwopus35coderflash,
title = {Qwopus3.5-9B-Coder-Flash},
author = {Jackrong},
year = {2026},
howpublished = {Hugging Face},
url = {https://huggingface.co/Jackrong/Qwopus3-5-9B-Coder-Flash}
}
- Downloads last month
- 18





