Hayula-Algorithm-7B-LoRA
Code Generation — Specialized LoRA adapter for Averroes-Q-Instruct.
Part of the Hayula Swarm.
Training
- Base: Averroes-Q-Instruct (Qwen2.5-7B)
- Iterations: 500
- LoRA Rank: 8 | Alpha: 16 | Scale: 20.0
- LR: 1e-5 | Batch: 4 | Max Seq: 2048