|
|
--- |
|
|
language: |
|
|
- zh |
|
|
- en |
|
|
- ja |
|
|
- ko |
|
|
- es |
|
|
license: cc-by-nc-4.0 |
|
|
pipeline_tag: audio-to-audio |
|
|
tags: |
|
|
- music |
|
|
- art |
|
|
arxiv: 2601.10547 |
|
|
--- |
|
|
|
|
|
# HeartCodec-oss |
|
|
|
|
|
HeartCodec-oss is a high-fidelity music codec tokenizer introduced in the paper [HeartMuLa: A Family of Open Sourced Music Foundation Models](https://huggingface.co/papers/2601.10547). |
|
|
|
|
|
HeartCodec is a low-frame-rate (12.5 Hz) yet high-fidelity music codec tokenizer that captures long-range musical structure while preserving fine-grained acoustic details and enabling efficient autoregressive modeling. It serves as a core component for the HeartMuLa song generation models. |
|
|
|
|
|
## Model Details |
|
|
|
|
|
- **Developed by:** Ario Scale Global |
|
|
- **Model Type:** Music Codec / Tokenizer |
|
|
- **License:** [CC-BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/) |
|
|
- **Paper:** [HeartMuLa: A Family of Open Sourced Music Foundation Models](https://huggingface.co/papers/2601.10547) |
|
|
- **Project Page:** [https://heartmula.github.io/](https://heartmula.github.io/) |
|
|
- **GitHub Repository:** [https://github.com/HeartMuLa/heartlib](https://github.com/HeartMuLa/heartlib) |
|
|
|
|
|
## Authors |
|
|
[Dongchao Yang](https://huggingface.co/Dongchao), [Yuxin Xie](https://huggingface.co/bverxie), Yuguo Yin, Zheyu Wang, Xiaoyu Yi, [Gongxi Zhu](https://huggingface.co/Gongxizhu), Xiaolong Weng, Zihan Xiong, Yingzhe Ma, Dading Cong, Jingliang Liu, Zihang Huang, Jinghan Ru, Rongjie Huang, Haoran Wan, Peixu Wang, Kuoxi Yu, Helin Wang, Liming Liang, Xianwei Zhuang, [Yuanyuan Wang](https://huggingface.co/YuanyuanWang), [Haohan Guo](https://huggingface.co/hhguo), Junjie Cao, Zeqian Ju, Songxiang Liu, Yuewen Cao, Heming Weng, Yuexian Zou. |
|
|
|
|
|
## Get Started |
|
|
|
|
|
Check the GitHub repository [HeartMuLa/heartlib](https://github.com/HeartMuLa/heartlib) for environment setup and local deployment instructions. |
|
|
|
|
|
### Installation |
|
|
```bash |
|
|
git clone https://github.com/HeartMuLa/heartlib.git |
|
|
cd heartlib |
|
|
pip install -e . |
|
|
``` |
|
|
|
|
|
### Download Checkpoints |
|
|
```bash |
|
|
# Using huggingface-cli |
|
|
hf download --local-dir './ckpt/HeartCodec-oss' 'HeartMuLa/HeartCodec-oss' |
|
|
``` |
|
|
|
|
|
## Citation |
|
|
|
|
|
If you find HeartMuLa or HeartCodec useful, please cite: |
|
|
|
|
|
```bibtex |
|
|
@misc{yang2026heartmulafamilyopensourced, |
|
|
title={HeartMuLa: A Family of Open Sourced Music Foundation Models}, |
|
|
author={Dongchao Yang and Yuxin Xie and Yuguo Yin and Zheyu Wang and Xiaoyu Yi and Gongxi Zhu and Xiaolong Weng and Zihan Xiong and Yingzhe Ma and Dading Cong and Jingliang Liu and Zihang Huang and Jinghan Ru and Rongjie Huang and Haoran Wan and Peixu Wang and Kuoxi Yu and Helin Wang and Liming Liang and Xianwei Zhuang and Yuanyuan Wang and Haohan Guo and Junjie Cao and Zeqian Ju and Songxiang Liu and Yuewen Cao and Heming Weng and Yuexian Zou}, |
|
|
year={2026}, |
|
|
eprint={2601.10547}, |
|
|
archivePrefix={arXiv}, |
|
|
primaryClass={cs.SD}, |
|
|
url={https://arxiv.org/abs/2601.10547}, |
|
|
} |
|
|
``` |
|
|
|
|
|
## Contact |
|
|
If you are interested in HeartMuLa, feel free to reach us at heartmula.ai@gmail.com |
