---
license: mit
base_model:
- Qwen/Qwen3.5-4B
tags:
- code
---
---
## license: mit
# ๐ง Nexora-Qwen-Coder-4B
### Compact Agentic Coding Model
**Coding ยท Debugging ยท Tool Use ยท Structured Reasoning ยท Local AI**
[](https://huggingface.co/guell00/Nexora-Qwen-Coder-4B)
[](https://github.com/ggerganov/llama.cpp)
[](https://unsloth.ai/)
[](#-license)
---
> **Nexora-Qwen-Coder-4B** is a compact, coding-focused language model fine-tuned from the **Qwen 3.5 4B family**, with an emphasis on **code generation, debugging, structured reasoning, tool use, and local agentic workflows**.
The core idea behind Nexora is simple:
> **A small coding model should do more than generate code. It should understand the task, reason through problems, interact with tools, inspect feedback, and iterate toward a solution.**
Designed for developers who want capable AI assistance without requiring a large datacenter-scale deployment.
---
# โฆ Model Overview
| Property | Details |
| :------------------- | :----------------------------- |
| **Model** | `Nexora-Qwen-Coder-4B` |
| **Hugging Face** | `guell00/Nexora-Qwen-Coder-4B` |
| **Base Model** | Qwen 3.5 4B |
| **Architecture** | Dense Transformer |
| **Model Class** | 4B Parameters |
| **Primary Focus** | Coding & Agentic Workflows |
| **Fine-Tuning** | Nexora Fine-Tuning |
| **Training Method** | SFT + Curriculum Learning |
| **Reasoning Data** | Trace Inversion |
| **Agent Data** | Tool-Use & Agent Trajectories |
| **Training Context** | Up to 32K tokens |
| **Evaluation** | MTP, `n=2` |
| **Format** | GGUF |
| **Inference** | llama.cpp compatible |
---
# โก Why Nexora?
Nexora-Qwen-Coder-4B is not designed around parameter count alone.
The objective is to make a **compact local model more useful for real software development workflows**.
The fine-tuning strategy focuses on four primary capabilities:
### `01` ยท Coding
Generate, complete, explain, refactor, and implement code across common programming tasks.
### `02` ยท Debugging
Analyze errors, identify potential failure points, reason about bugs, and produce targeted fixes.
### `03` ยท Agentic Workflows
Operate in environments where the model can inspect files, select tools, execute actions, receive feedback, and iterate.
### `04` ยท Structured Reasoning
Handle multi-step technical tasks that benefit from planning, decomposition, and structured problem solving.
---
# ๐๏ธ Recommended Sampling
For the best balance of **consistency, coding quality, and controlled generation**, the recommended default configuration is:
| Parameter | Recommended |
| :--------------------- | :---------: |
| **Temperature** | `0.1` |
| **Top P** | `0.95` |
| **Top K** | `52` |
| **Min P** | `0.05` |
| **Repetition Penalty** | `1.1` |
| **Presence Penalty** | `Off` |
### Default Configuration
```text
Temperature: 0.1
Top P: 0.95
Top K: 52
Min P: 0.05
Repetition Penalty: 1.1
Presence Penalty: Off
```
This configuration is recommended for:
* Code generation
* Code completion
* Debugging
* Refactoring
* Technical reasoning
* Tool calling
* Agentic coding workflows
The low `Temperature` is intended to improve consistency while preserving a small amount of generation flexibility.
> **Note:** Evaluation results may vary when using sampling parameters different from those used during benchmarking.
---
# ๐ Benchmark Performance
Nexora-Qwen-Coder-4B was evaluated locally using the **benchlocal** evaluation framework.
The evaluation focuses primarily on practical developer workflows, including debugging, tool use, agent behavior, and instruction following.
## Results
| Benchmark | Nexora-Qwen-Coder-4B | Qwen 3.5 4B | Delta |
| :-------------------- | -------------------: | ----------: | ------: |
| **BugFind-15** | **71 / 100** | 52 / 100 | **+19** |
| **HermesAgent-20** | **64 / 100** | 61 / 100 | **+3** |
| **ToolCall-15** | **100 / 100** | 90 / 100 | **+10** |
| **InstructFollow-15** | **93 / 100** | 93 / 100 | **0** |
### Relative Evaluation Snapshot
```text
BugFind-15
Nexora-Qwen-Coder-4B โโโโโโโโโโโโโโโโโโโโ 71
Qwen 3.5 4B โโโโโโโโโโโโโโโโโโโโ 52
HermesAgent-20
Nexora-Qwen-Coder-4B โโโโโโโโโโโโโโโโโโโโ 64
Qwen 3.5 4B โโโโโโโโโโโโโโโโโโโโ 61
ToolCall-15
Nexora-Qwen-Coder-4B โโโโโโโโโโโโโโโโโโโโ 100
Qwen 3.5 4B โโโโโโโโโโโโโโโโโโโโ 90
InstructFollow-15
Nexora-Qwen-Coder-4B โโโโโโโโโโโโโโโโโโโโ 93
Qwen 3.5 4B โโโโโโโโโโโโโโโโโโโโ 93
```
### Key Observations
The strongest observed results were in:
* **Debugging**
* **Tool calling**
* **Coding-oriented workflows**
* **Instruction following**
* **Local agent scenarios**
These results suggest that the fine-tuning process improved the model's performance on targeted coding and agentic tasks compared with the base evaluation reference.
> Benchmark results are snapshots from specific evaluation runs. They should not be interpreted as universal performance guarantees.
---
# ๐ค Agentic Coding
Nexora-Qwen-Coder-4B is designed for workflows where the model can interact with an external environment rather than simply returning a single static answer.
A typical agent loop can be represented as:
```text
โโโโโโโโโโโโโโโโโโโโ
โ User Request โ
โโโโโโโโโโฌโโโโโโโโโโ
โ
โผ
โโโโโโโโโโโโโโโโโโโโ
โ Understand Task โ
โโโโโโโโโโฌโโโโโโโโโโ
โ
โผ
โโโโโโโโโโโโโโโโโโโโ
โ Plan Solution โ
โโโโโโโโโโฌโโโโโโโโโโ
โ
โผ
โโโโโโโโโโโโโโโโโโโโ
โ Select Tool โ
โโโโโโโโโโฌโโโโโโโโโโ
โ
โผ
โโโโโโโโโโโโโโโโโโโโ
โ Execute Action โ
โโโโโโโโโโฌโโโโโโโโโโ
โ
โผ
โโโโโโโโโโโโโโโโโโโโ
โ Inspect Feedback โ
โโโโโโโโโโฌโโโโโโโโโโ
โ
โผ
Success?
โฑ โฒ
Yes No
โ โ
โผ โ
โโโโโโโโโโโโโ โ
โ Final โ โ
โ Answer โ โ
โโโโโโโโโโโโโ โ
โ
โโโโโโโโบ Iterate
```
This makes the model suitable for local environments that expose tools such as:
* File operations
* Terminal execution
* Code search
* Repository inspection
* Build systems
* Test runners
* Linters
* Debugging environments
Typical agent workflows may include:
```text
Read โ Plan โ Act โ Observe โ Verify โ Repair
```
Tool-call reliability depends on the application's prompt template, tool definitions, schema design, and execution environment.
---
# ๐งฉ Recommended Use Cases
| Use Case | Fit |
| :------------------------ | :---: |
| **Code Generation** | โ
โ
โ
โ
โ
|
| **Debugging** | โ
โ
โ
โ
โ
|
| **Tool Calling** | โ
โ
โ
โ
โ
|
| **Local Coding Agents** | โ
โ
โ
โ
โ
|
| **Code Explanation** | โ
โ
โ
โ
โ
|
| **Refactoring** | โ
โ
โ
โ
โ |
| **Repository Analysis** | โ
โ
โ
โ
โ |
| **Technical Reasoning** | โ
โ
โ
โ
โ |
| **Documentation** | โ
โ
โ
โ
โ |
| **Software Architecture** | โ
โ
โ
โโ |
### Best suited for
* Code generation
* Code completion
* Debugging
* Bug localization
* Error analysis
* Refactoring
* Repository inspection
* Tool calling
* Local coding agents
* Multi-step development tasks
* Technical reasoning
* Developer assistants
---
# ๐ฅ๏ธ Built for Local AI
The **4B parameter class** is intentionally compact.
Nexora-Qwen-Coder-4B aims to provide a practical balance between:
```text
CAPABILITY
โฒ
โ
โ โ Nexora-Qwen-Coder-4B
โ
โ
โ
โโโโโโโโโโโโโโโโโโโโโโโโโโบ
LOCAL EFFICIENCY
```
The goal is straightforward:
> **Deliver useful coding and agentic capabilities while remaining practical to run locally.**
Potential deployment scenarios include:
* Local development
* Personal coding assistants
* Offline workflows
* Lightweight coding agents
* Developer workstations
* Experimental AI agents
* Privacy-focused development environments
---
# ๐ฆ Model Files & Quantization
Nexora-Qwen-Coder-4B is available in **GGUF** format for efficient local inference.
| Quantization | Recommended For |
| :----------- | :--------------------------------------------------- |
| **Q4_K_M** | Best balance of quality, memory, and speed |
| **Q8_0** | Higher quantized quality with increased memory usage |
### Recommended: `Q4_K_M`
For most users, `Q4_K_M` provides a strong balance between:
`Quality` ยท `Memory` ยท `Speed`
### Higher Quality: `Q8_0`
Recommended when memory usage is less restrictive and higher quantized fidelity is preferred.
---
# ๐ Quick Start
## llama.cpp
Run the model directly from Hugging Face:
```bash
llama-cli -hf guell00/Nexora-Qwen-Coder-4B --jinja
```
Start an OpenAI-compatible local server:
```bash
llama-server -hf guell00/Nexora-Qwen-Coder-4B --jinja
```
> Command availability may depend on your installed `llama.cpp` version and the model files available in the repository.
---
# ๐ง Context Length
The model was fine-tuned using sequences reaching approximately **32K tokens**.
The underlying Qwen 3.5 family may support larger context windows depending on the specific architecture and inference backend.
Long-context performance depends on:
* Backend support
* RoPE configuration
* YaRN scaling
* Quantization
* KV cache
* Available memory
* Context length
When extending beyond the training distribution, users should validate performance on their own workloads.
### Example: Extended Context with llama.cpp
```bash
./llama-server \
-m model.gguf \
--ctx-size 131072 \
--rope-scaling yarn \
--rope-scale 4 \
--yarn-orig-ctx 32768
```
> **Important:** Increasing `--ctx-size` alone does not guarantee reliable long-context behavior.
---
# ๐ฏ Deterministic Coding Configuration
For highly deterministic coding, debugging, and code-repair workflows:
| Parameter | Value |
| :--------------------- | :----: |
| **Temperature** | `0` |
| **Top P** | `0.95` |
| **Top K** | `40` |
| **Min P** | `0.05` |
| **Repetition Penalty** | `1.1` |
| **Presence Penalty** | `Off` |
| **Max Tokens** | `Max` |
```text
Temperature: 0
Top P: 0.95
Top K: 40
Min P: 0.05
Repetition Penalty: 1.1
Presence Penalty: Off
Max Tokens: Max
```
For creative programming, brainstorming, or exploratory generation, increasing the temperature may produce more diverse outputs.
For debugging and code repair, lower temperatures generally provide more deterministic results.
---
# ๐ง Built With
| Technology | Role |
| :------------- | :--------------------------------- |
| **Qwen** | Base model family |
| **Unsloth** | Fine-tuning & conversion workflows |
| **GGUF** | Efficient local model format |
| **llama.cpp** | Local inference |
| **benchlocal** | Coding & agent evaluation |
---
# โ ๏ธ Limitations
Nexora-Qwen-Coder-4B is a compact **4B-class model** and should be evaluated accordingly.
It may struggle with:
* Extremely large repository-wide changes
* Complex multi-file dependencies
* Highly specialized professional domains
* Tasks requiring extensive external knowledge
* Long autonomous workflows without verification
* Deep architectural decisions involving large systems
The model should be treated as a **coding assistant**, not a fully autonomous software engineer.
Generated code should always be:
```text
REVIEWED
โ
TESTED
โ
VALIDATED
โ
DEPLOYED
```
Applications should verify generated code before using it in production environments.
Depending on the inference template and runtime configuration, the model may generate reasoning content inside:
```text
...
```
Applications may parse, hide, or otherwise handle these sections according to their requirements.
---
# ๐ Acknowledgements
Special thanks to:
* The **Qwen team** for the base model family.
* The **Unsloth team** for efficient fine-tuning and conversion tooling.
* The open-source AI community for datasets, tools, and research.
* Contributors supporting local hardware testing and evaluation.
---
# ๐ License
This model is released under the **MIT License**.
Please review the licensing terms of the underlying base model and any third-party components used in your deployment.
---
# โ๏ธ Disclaimer
Nexora-Qwen-Coder-4B is provided for:
**Research ยท Development ยท Experimentation ยท Local Inference**
Actual performance may vary depending on:
* Quantization method
* Inference backend
* Hardware
* Context length
* Prompt formatting
* Sampling parameters
* Evaluation methodology
Benchmark results represent specific evaluation runs and should not be interpreted as guaranteed performance across all environments or tasks.
Always review, test, and validate generated code before deploying it to production systems.
---
# ๐ง Nexora
### Intelligence. Code. Evolve.
**Built for developers who want capable AI coding assistance running locally.**
`guell00/Nexora-Qwen-Coder-4B`
[Hugging Face](https://huggingface.co/guell00/Nexora-Qwen-Coder-4B)