---
license: apache-2.0
tags:
- music
- SSL
- pytorch
---

## Frequency-Aware Self-Supervised Music Representation Learning

This is the official Hugging Face model repository for the paper **"[Frequency-Aware Self-Supervised Music Representation Learning](TBD)"**.

For more details, please visit our [GitHub Repository](https://github.com/sizigi/PupuJEPA).

## Model Checkpoints

This repository contains the following checkpoints:

| Model Name        | Directory                    | Description                                       |
| ----------------- | ---------------------------- | ------------------------------------------------- |
| **PupuJEPA-Tiny**            | `./PupuJEPAV2_25Hz_tiny/*`            | 5M parameter tiny version of PupuJEPA.   |
| **PupuJEPA-Small**            | `./PupuJEPAV2_25Hz_small/*`            | 22M parameter small version of PupuJEPA.   |
| **PupuJEPA-Base**            | `./PupuJEPAV2_25Hz_base/*`            | 86M parameter base version of PupuJEPA.   |
| **PupuJEPA-Large**            | `./PupuJEPAV2_25Hz_large/*`            | 307M parameter large version of PupuJEPA.   |
| **PupuJEPA-Huge**            | `./PupuJEPAV2_25Hz_huge/*`            | 632M parameter huge version of PupuJEPA.   |
| **PupuJEPA-giant**            | `./PupuJEPAV2_25Hz_giant/*`            | 1.1B parameter giant version of PupuJEPA.   |

## How to use

You need to put the pretrained models in:

```bash
  PupuJEPA/experiments
```

of our official repository.

## Citation

```bibtex
@article{PupuJEPA,
  title        = {Frequency-Aware Self-Supervised Music Representation Learning},
  author       = {Yicheng Gu and Junan Zhang and Jerry Li and Zhizheng Wu and Lauri Juvela},
  year         = {2026},
  journal      = {TBD},
}
```