hayulalab/averroes-q-instruct-paper

Averroes-Q-Instruct: A Bilingual Arabic-English 7B Instruction-Tuned Model for the Hayula Ecosystem — Hayula Research

Hayula AI Lab

Abstract

We present Averroes-Q-Instruct (ابن رشد), a bilingual Arabic-English 7-billion parameter instruction-tuned language model built on Qwen2.5-7B-Instruct. The model was fine-tuned on 55K human-written instructions spanning both Arabic and English, using Low-Rank Adaptation (LoRA) via the MLX framework on a single Apple M2 Ultra workstation with 192GB unified memory. Averroes-Q-Instruct achieves a final training loss of 1.434, demonstrating effective bilingual instruction following without catastrop

Files

File	Description
paper.md	Full paper (Markdown)
README.md	This model card

Citation

@techreport{hayulalab2026averroesqinstruct,
    title={Averroes-Q-Instruct: A Bilingual Arabic-English 7B Instruction-Tuned Model for the Hayula Ecosystem — Hayula Research},
    author={Hayula AI Lab},
    year={2026},
    url={https://huggingface.co/hayulalab/averroes-q-instruct-paper}
}

---

hayulalab — Open Source AI Research