File size: 1,403 Bytes
303d42d
96558cb
 
 
 
303d42d
96558cb
 
303d42d
 
96558cb
 
303d42d
 
96558cb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
---
title: MuQ-MuLan
emoji: 🎧
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 5.28.0
python_version: '3.12'
app_file: app.py
pinned: false
license: cc-by-nc-4.0
short_description: Rank music descriptions against an audio clip
---

# MuQ-MuLan Music-Text Similarity

A HARP-compatible deployment of MuQ-MuLan for comparing a music clip with
candidate text descriptions. It can support workflows such as tagging,
searching a sample library, or choosing the description that best matches a
piece of music.

The Space loads the official MuQ-MuLan-large checkpoint from Hugging Face.
Model files are downloaded at runtime and cached by the Space.

## Inputs

- One music audio clip between 10 and 60 seconds
- One to eight candidate descriptions, one per line

Audio is converted to mono and resampled to 24 kHz. MuQ-MuLan processes
10-second windows and averages their embeddings for longer clips. Candidate
descriptions should be written in English.

## Output

A JSON file containing the candidate descriptions in descending similarity
order. Scores are cosine similarities from -1 to 1, not calibrated
probabilities.

## Sources

See [SOURCES.md](SOURCES.md) for the model, source revision, license, and
associated paper.

## License

The upstream source code is MIT licensed. The MuQ-MuLan model weights are
released under CC BY-NC 4.0, so this deployment is intended for
non-commercial use.