Nero-800M
Nero-800M is a compact open-source language model based on Qwen3.5-0.8B, fine-tuned to improve instruction following, conversational ability, and reasoning behavior while maintaining fast and efficient inference.
Nero-800M is designed for users who want a capable AI assistant that can run locally on limited hardware.
Model Details
| Detail | Value |
|---|---|
| Base Model | unsloth/Qwen3.5-0.8B |
| Parameters | ~800M |
| Fine-tuning | QLoRA + LoRA SFT |
| Context Length | 2048 tokens |
| Architecture | Decoder-only Transformer |
Training
Nero-800M was trained using parameter-efficient fine-tuning methods:
- Supervised Fine-Tuning (SFT)
- QLoRA
- LoRA refinement
Training focused on:
- Instruction following
- Helpful assistant behavior
- Response formatting
- Reasoning improvements
Intended Use
Nero-800M is suitable for:
- Local AI assistants
- Edge devices
- Lightweight chat applications
- AI experimentation
- Educational projects
Limitations
Due to its compact size, Nero-800M may:
- Have weaker reasoning than larger models
- Make factual mistakes
- Struggle with complex multi-step tasks
For more demanding workloads, larger Nero models are recommended.
Credits
Built with:
- Qwen3.5
- Unsloth
- Open-source AI community
- Downloads last month
- 106
Model tree for j0no12/Nero-800M
Collection including j0no12/Nero-800M
Collection
Nero is an experimental series of open-source models exploring efficient training, alignment, and scalable intelligence across model sizes. • 1 item • Updated