Spaces:
Running
Running
cut to 4s
Browse files
README.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
title: Music Descriptor
|
| 3 |
emoji: 🚀
|
| 4 |
colorFrom: blue
|
| 5 |
-
colorTo:
|
| 6 |
sdk: gradio
|
| 7 |
sdk_version: 3.29.0
|
| 8 |
app_file: app.py
|
|
@@ -16,7 +16,6 @@ license: cc-by-nc-4.0
|
|
| 16 |
This is an example of using the [MERT-v1-95M](https://huggingface.co/m-a-p/MERT-v1-95M) model as backbone to conduct multiple music understanding tasks with the universal representation.
|
| 17 |
|
| 18 |
The tasks include EMO, GS, MTGInstrument, MTGGenre, MTGTop50, MTGMood, NSynthI, NSynthP, VocalSetS, VocalSetT.
|
| 19 |
-
|
| 20 |
More models can be referred at the [map organization page](https://huggingface.co/m-a-p).
|
| 21 |
|
| 22 |
# Known Issues
|
|
@@ -25,16 +24,11 @@ More models can be referred at the [map organization page](https://huggingface.c
|
|
| 25 |
|
| 26 |
Theorectically, all the audio formats supported by [torchaudio.load()](https://pytorch.org/audio/stable/torchaudio.html#torchaudio.load) can be used in the demo. Theese should include but not limited to `WAV, AMB, MP3, FLAC`.
|
| 27 |
|
| 28 |
-
##
|
| 29 |
-
|
| 30 |
-
Due the **hardware limitation** of the machine hosting our demospecification (2 CPU and 16GB RAM), there might be `Error` output when uploading long audios.
|
| 31 |
-
|
| 32 |
-
Unfortunately, we couldn't fix this in a short time since our team are all volunteer researchers.
|
| 33 |
|
| 34 |
-
|
| 35 |
|
| 36 |
-
This issue is expected to solve in the future by applying more community-support GPU resources or using other audio encoding
|
| 37 |
|
| 38 |
-
In the current stage, if you want to directly run the demo with longer audios, you could
|
| 39 |
-
|
| 40 |
-
* develop your own application with the MERT models if you have the experience of machine learning.
|
|
|
|
| 2 |
title: Music Descriptor
|
| 3 |
emoji: 🚀
|
| 4 |
colorFrom: blue
|
| 5 |
+
colorTo: green
|
| 6 |
sdk: gradio
|
| 7 |
sdk_version: 3.29.0
|
| 8 |
app_file: app.py
|
|
|
|
| 16 |
This is an example of using the [MERT-v1-95M](https://huggingface.co/m-a-p/MERT-v1-95M) model as backbone to conduct multiple music understanding tasks with the universal representation.
|
| 17 |
|
| 18 |
The tasks include EMO, GS, MTGInstrument, MTGGenre, MTGTop50, MTGMood, NSynthI, NSynthP, VocalSetS, VocalSetT.
|
|
|
|
| 19 |
More models can be referred at the [map organization page](https://huggingface.co/m-a-p).
|
| 20 |
|
| 21 |
# Known Issues
|
|
|
|
| 24 |
|
| 25 |
Theorectically, all the audio formats supported by [torchaudio.load()](https://pytorch.org/audio/stable/torchaudio.html#torchaudio.load) can be used in the demo. Theese should include but not limited to `WAV, AMB, MP3, FLAC`.
|
| 26 |
|
| 27 |
+
## Audio Input Length
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
+
Due the **hardware limitation** of the machine hosting this demo (2 CPU and 16GB RAM) only the first 4 seconds of audio are used!
|
| 30 |
|
| 31 |
+
This issue is expected to solve in the future by applying more community-support GPU resources or using other audio encoding strategies.
|
| 32 |
|
| 33 |
+
In the current stage, if you want to directly run the demo with longer audios, you could clone this space and deploy with GPU.
|
| 34 |
+
The code will automatically use GPU for inference if there is GPU that can be detected by `torch.cuda.is_available()`.
|
|
|