| --- |
| license: apache-2.0 |
| tags: |
| - music |
| - SSL |
| - pytorch |
| --- |
| |
| ## Frequency-Aware Self-Supervised Music Representation Learning |
|
|
| This is the official Hugging Face model repository for the paper **"[Frequency-Aware Self-Supervised Music Representation Learning](TBD)"**. |
|
|
| For more details, please visit our [GitHub Repository](https://github.com/sizigi/PupuJEPA). |
|
|
| ## Model Checkpoints |
|
|
| This repository contains the following checkpoints: |
|
|
| | Model Name | Directory | Description | |
| | ----------------- | ---------------------------- | ------------------------------------------------- | |
| | **PupuJEPA-Tiny** | `./PupuJEPAV2_25Hz_tiny/*` | 5M parameter tiny version of PupuJEPA. | |
| | **PupuJEPA-Small** | `./PupuJEPAV2_25Hz_small/*` | 22M parameter small version of PupuJEPA. | |
| | **PupuJEPA-Base** | `./PupuJEPAV2_25Hz_base/*` | 86M parameter base version of PupuJEPA. | |
| | **PupuJEPA-Large** | `./PupuJEPAV2_25Hz_large/*` | 307M parameter large version of PupuJEPA. | |
| | **PupuJEPA-Huge** | `./PupuJEPAV2_25Hz_huge/*` | 632M parameter huge version of PupuJEPA. | |
| | **PupuJEPA-giant** | `./PupuJEPAV2_25Hz_giant/*` | 1.1B parameter giant version of PupuJEPA. | |
|
|
| ## How to use |
|
|
| You need to put the pretrained models in: |
|
|
| ```bash |
| PupuJEPA/experiments |
| ``` |
|
|
| of our official repository. |
|
|
| ## Citation |
|
|
| ```bibtex |
| @article{PupuJEPA, |
| title = {Frequency-Aware Self-Supervised Music Representation Learning}, |
| author = {Yicheng Gu and Junan Zhang and Jerry Li and Zhizheng Wu and Lauri Juvela}, |
| year = {2026}, |
| journal = {TBD}, |
| } |
| ``` |
