language:
- zh
- en
- ja
- ko
- es
license: cc-by-nc-4.0
pipeline_tag: audio-to-audio
tags:
- music
- art
arxiv: 2601.10547
HeartCodec-oss
HeartCodec-oss is a high-fidelity music codec tokenizer introduced in the paper HeartMuLa: A Family of Open Sourced Music Foundation Models.
HeartCodec is a low-frame-rate (12.5 Hz) yet high-fidelity music codec tokenizer that captures long-range musical structure while preserving fine-grained acoustic details and enabling efficient autoregressive modeling. It serves as a core component for the HeartMuLa song generation models.
Model Details
- Developed by: Ario Scale Global
- Model Type: Music Codec / Tokenizer
- License: CC-BY-NC 4.0
- Paper: HeartMuLa: A Family of Open Sourced Music Foundation Models
- Project Page: https://heartmula.github.io/
- GitHub Repository: https://github.com/HeartMuLa/heartlib
Authors
Dongchao Yang, Yuxin Xie, Yuguo Yin, Zheyu Wang, Xiaoyu Yi, Gongxi Zhu, Xiaolong Weng, Zihan Xiong, Yingzhe Ma, Dading Cong, Jingliang Liu, Zihang Huang, Jinghan Ru, Rongjie Huang, Haoran Wan, Peixu Wang, Kuoxi Yu, Helin Wang, Liming Liang, Xianwei Zhuang, Yuanyuan Wang, Haohan Guo, Junjie Cao, Zeqian Ju, Songxiang Liu, Yuewen Cao, Heming Weng, Yuexian Zou.
Get Started
Check the GitHub repository HeartMuLa/heartlib for environment setup and local deployment instructions.
Installation
git clone https://github.com/HeartMuLa/heartlib.git
cd heartlib
pip install -e .
Download Checkpoints
# Using huggingface-cli
hf download --local-dir './ckpt/HeartCodec-oss' 'HeartMuLa/HeartCodec-oss'
Citation
If you find HeartMuLa or HeartCodec useful, please cite:
@misc{yang2026heartmulafamilyopensourced,
title={HeartMuLa: A Family of Open Sourced Music Foundation Models},
author={Dongchao Yang and Yuxin Xie and Yuguo Yin and Zheyu Wang and Xiaoyu Yi and Gongxi Zhu and Xiaolong Weng and Zihan Xiong and Yingzhe Ma and Dading Cong and Jingliang Liu and Zihang Huang and Jinghan Ru and Rongjie Huang and Haoran Wan and Peixu Wang and Kuoxi Yu and Helin Wang and Liming Liang and Xianwei Zhuang and Yuanyuan Wang and Haohan Guo and Junjie Cao and Zeqian Ju and Songxiang Liu and Yuewen Cao and Heming Weng and Yuexian Zou},
year={2026},
eprint={2601.10547},
archivePrefix={arXiv},
primaryClass={cs.SD},
url={https://arxiv.org/abs/2601.10547},
}
Contact
If you are interested in HeartMuLa, feel free to reach us at heartmula.ai@gmail.com