| language: | |
| - en | |
| - ar | |
| tags: | |
| - hayula | |
| - swarm | |
| - lora | |
| - adapter | |
| license: apache-2.0 | |
| # Hayula-Algorithm-7B-LoRA | |
| **Code Generation** — Specialized LoRA adapter for Averroes-Q-Instruct. | |
| Part of the Hayula Swarm. | |
| ## Training | |
| - Base: Averroes-Q-Instruct (Qwen2.5-7B) | |
| - Iterations: 500 | |
| - LoRA Rank: 8 | Alpha: 16 | Scale: 20.0 | |
| - LR: 1e-5 | Batch: 4 | Max Seq: 2048 | |