| | --- |
| | license: apache-2.0 |
| | language: |
| | - en |
| | base_model: |
| | - janhq/Jan-code-4b |
| | pipeline_tag: text-generation |
| | library_name: transformers |
| | tags: |
| | - agent |
| | --- |
| | # Jan-Code-4B: a small code-tuned model |
| |
|
| | [](https://github.com/janhq/jan) |
| | [](https://opensource.org/licenses/Apache-2.0) |
| | [](https://jan.ai/) |
| |
|
| |  |
| |
|
| | ## Overview |
| |
|
| | **Jan-Code-4B** is a **code-tuned** model built on top of [Jan-v3-4B-base-instruct](https://huggingface.co/janhq/Jan-v3-4B-base-instruct). It’s designed to be a practical coding model you can run locally and iterate on quickly—useful for everyday code tasks and as a lightweight “worker” model in agentic workflows. |
| |
|
| | Compared to larger coding models, Jan-Code focuses on handling **well-scoped subtasks** reliably while keeping latency and compute requirements small. |
| |
|
| | ## Intended Use |
| |
|
| | * **Lightweight coding assistant** for generation, editing, refactoring, and debugging |
| | * **A small, fast worker model** for agent setups (e.g., as a sub-agent that produces patches/tests while a larger model plans) |
| | * **Replace Haiku model in Claude Code setup** |
| |
|
| |
|
| | ## Quick Start |
| |
|
| | ### Integration with Jan Apps |
| |
|
| | Jan-code is optimized for direct integration with [Jan Desktop](https://jan.ai/), select the model in the app to start using it. |
| |
|
| |
|
| | ### Local Deployment |
| |
|
| | **Using vLLM:** |
| | ```bash |
| | vllm serve janhq/Jan-code-4b \ |
| | --host 0.0.0.0 \ |
| | --port 1234 \ |
| | --enable-auto-tool-choice \ |
| | --tool-call-parser hermes |
| | |
| | ``` |
| |
|
| | **Using llama.cpp:** |
| | ```bash |
| | llama-server --model Jan-code-4b-Q8_0.gguf \ |
| | --host 0.0.0.0 \ |
| | --port 1234 \ |
| | --jinja \ |
| | --no-context-shift |
| | ``` |
| |
|
| | ### Recommended Parameters |
| | For optimal performance in agentic and general tasks, we recommend the following inference parameters: |
| | ```yaml |
| | temperature: 0.7 |
| | top_p: 0.8 |
| | top_k: 20 |
| | ``` |
| |
|
| | ## 🤝 Community & Support |
| |
|
| | - **Discussions**: [Hugging Face Community](https://huggingface.co/janhq/Jan-code/discussions) |
| | - **Jan App**: Learn more about the Jan App at [jan.ai](https://jan.ai/) |
| |
|
| | ## 📄 Citation |
| | ```bibtex |
| | Updated Soon |
| | ``` |
| |
|
