README.md

metadata

language:
  - en
  - ar
tags:
  - hayula
  - swarm
  - lora
  - adapter
license: apache-2.0

Hayula-Algorithm-7B-LoRA

Code Generation — Specialized LoRA adapter for Averroes-Q-Instruct.

Part of the Hayula Swarm.

Training

• Base: Averroes-Q-Instruct (Qwen2.5-7B)
• Iterations: 500
• LoRA Rank: 8 | Alpha: 16 | Scale: 20.0
• LR: 1e-5 | Batch: 4 | Max Seq: 2048