README.md

metadata

language:
  - zh
  - en
  - ja
  - ko
  - es
license: cc-by-nc-4.0
pipeline_tag: text-to-audio
tags:
  - music
  - art
arxiv: 2601.10547

HeartMuLa: A Family of Open Sourced Music Foundation Models

HeartMuLa is a family of open-source Music Foundation Models designed to advance large-scale music understanding and generation across diverse tasks and modalities.

This repository contains the weights for HeartMuLa-oss-3B, an LLM-based song generation model capable of synthesizing high-fidelity music under rich, user-controllable conditions (e.g., textual style descriptions, lyrics, and reference audio).

Model Details

• Developed by: Ario Scale Global
• License: CC-BY-NC 4.0
• Model Type: LLM-based Music Generation
• Supported Languages: English, Chinese, Japanese, Korean, Spanish, and more.

Model Sources

• Github Repo: https://github.com/HeartMuLa/heartlib
• Paper: arXiv:2601.10547
• Demo: https://heartmula.github.io/

HeartMuLa Family Checkpoints

• HeartMuLa-oss-3B: Base song generation model
• HeartCodec-oss: High-fidelity music codec tokenizer
• HeartTranscriptor-oss: Robust lyric recognition model

Get Started

Check the official GitHub repository HeartMuLa/heartlib for detailed setup and local deployment.

Installation

git clone https://github.com/HeartMuLa/heartlib.git
cd heartlib
pip install -e .

Sample Usage

To generate music conditioned on lyrics and style tags, run the following command after downloading the checkpoints:

python ./examples/run_music_generation.py --model_path=./ckpt --version="3B"

Parameters:

• --model_path: Path to the pretrained model checkpoint.
• --lyrics: Path to a text file containing lyrics (supports structure tags like [Intro], [Verse], [Chorus]).
• --tags: Comma-separated style tags (e.g., piano,happy,romantic).
• --version: The version of HeartMuLa (choose 3B).

Citation

If you find HeartMuLa useful, please cite:

@misc{yang2026heartmulafamilyopensourced,
      title={HeartMuLa: A Family of Open Sourced Music Foundation Models}, 
      author={Dongchao Yang and Yuxin Xie and Yuguo Yin and Zheyu Wang and Xiaoyu Yi and Gongxi Zhu and Xiaolong Weng and Zihan Xiong and Yingzhe Ma and Dading Cong and Jingliang Liu and Zihang Huang and Jinghan Ru and Rongjie Huang and Haoran Wan and Peixu Wang and Kuoxi Yu and Helin Wang and Liming Liang and Xianwei Zhuang and Yuanyuan Wang and Haohan Guo and Junjie Cao and Zeqian Ju and Songxiang Liu and Yuewen Cao and Heming Weng and Yuexian Zou},
      year={2026},
      eprint={2601.10547},
      archivePrefix={arXiv},
      primaryClass={cs.SD},
      url={https://arxiv.org/abs/2601.10547}, 
}

Contact

If you are interested in HeartMuLa, feel free to reach us at heartmula.ai@gmail.com