Instructions to use google/music-spectrogram-diffusion with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use google/music-spectrogram-diffusion with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("google/music-spectrogram-diffusion", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -23,13 +23,15 @@ As depicted above the model takes as input a MIDI file and tokenizes it into a s
|
|
| 23 |
## Example usage
|
| 24 |
|
| 25 |
```python
|
| 26 |
-
from diffusers import SpectrogramDiffusionPipeline
|
| 27 |
|
| 28 |
pipe = SpectrogramDiffusionPipeline.from_pretrained("google/music-spectrogram-diffusion")
|
| 29 |
pipe = pipe.to("cuda")
|
| 30 |
|
| 31 |
# Download via: wget http://www.piano-midi.de/midis/beethoven/beethoven_hammerklavier_2.mid
|
| 32 |
-
|
|
|
|
|
|
|
| 33 |
|
| 34 |
audio = output.audios[0]
|
| 35 |
```
|
|
|
|
| 23 |
## Example usage
|
| 24 |
|
| 25 |
```python
|
| 26 |
+
from diffusers import SpectrogramDiffusionPipeline, MidiProcessor
|
| 27 |
|
| 28 |
pipe = SpectrogramDiffusionPipeline.from_pretrained("google/music-spectrogram-diffusion")
|
| 29 |
pipe = pipe.to("cuda")
|
| 30 |
|
| 31 |
# Download via: wget http://www.piano-midi.de/midis/beethoven/beethoven_hammerklavier_2.mid
|
| 32 |
+
processor = MidiProcessor()
|
| 33 |
+
|
| 34 |
+
output = pipe(processor("beethoven_hammerklavier_2.mid"))
|
| 35 |
|
| 36 |
audio = output.audios[0]
|
| 37 |
```
|