---
language:
- en
- ar
tags:
- hayula
- swarm
- lora
- adapter
license: apache-2.0
---

# Hayula-Algorithm-7B-LoRA

**Code Generation** — Specialized LoRA adapter for Averroes-Q-Instruct.

Part of the Hayula Swarm.

## Training
- Base: Averroes-Q-Instruct (Qwen2.5-7B)
- Iterations: 500
- LoRA Rank: 8 | Alpha: 16 | Scale: 20.0
- LR: 1e-5 | Batch: 4 | Max Seq: 2048