rtikw commited on
Commit
7196ce7
·
verified ·
1 Parent(s): c8ee34a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +107 -0
README.md ADDED
@@ -0,0 +1,107 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - music
5
+ - song-generation
6
+ - lyrics-to-song
7
+ ---
8
+ # SongBloom (150 s checkpoints) (mirror)
9
+
10
+ ## Provenance (mirror)
11
+
12
+ This is an **unmodified mirror** hosted for reliable download by the
13
+ LocalMusic app. Original files, checksums untouched; mirrored 2026-08-25.
14
+
15
+ - **Original source**: https://modelscope.cn/models/AI-ModelScope/SongBloom (official GitHub/HF repos deleted by the authors; code survives in the rsxdalv/SongBloom fork)
16
+ - **Original authors**: The SongBloom authors (see original card)
17
+ - **License**: Apache-2.0 (as declared by the original distribution — see
18
+ front-matter and LICENSE)
19
+ - Mirrored because: upstream is orphaned — the official repos were deleted and ModelScope is the last host; this mirror is archival as much as practical
20
+
21
+ All credit belongs to the original authors. If you are an author and want
22
+ this mirror changed or removed, open a discussion on this repo.
23
+
24
+ ---
25
+
26
+ # Original model card
27
+
28
+ ---
29
+ language:
30
+ - en
31
+ - zh
32
+ library_name: songbloom
33
+ license: apache-2.0
34
+ pipeline_tag: text-to-audio
35
+ ---
36
+
37
+ ## Introduction
38
+ We propose SongBloom, a novel framework for full-length song generation that leverages an interleaved paradigm of autoregressive sketching and diffusion-based refinement. SongBloom employs an autoregressive diffusion model that combines the high fidelity of diffusion models with the scalability of language models. Specifically, it gradually extends a musical sketch from short to long and refines the details from coarse to fine-grained. The interleaved generation paradigm effectively integrates prior semantic and acoustic context to guide the generation process. Experimental results demonstrate that SongBloom outperforms existing methods across both subjective and objective metrics and achieves performance comparable to the state-of-the-art commercial music generation platforms.
39
+
40
+ ## Project Page
41
+ https://cypress-yang.github.io/SongBloom_demo/
42
+
43
+ ## Usage
44
+
45
+ ### Prepare Environments
46
+
47
+ ```bash
48
+ conda create -n SongBloom python==3.8.12
49
+ conda activate SongBloom
50
+
51
+ # yum install libsndfile
52
+ # pip install torch==2.2.0 torchaudio==2.2.0 --index-url https://download.pytorch.org/whl/cu118 # For different CUDA version
53
+ pip install -r requirements.txt
54
+ ```
55
+
56
+ ### Data Preparation
57
+
58
+ A .jsonl file, where each line is a json object:
59
+
60
+ ```json
61
+ {
62
+ "idx": "The index of each sample",
63
+ "lyrics": "The lyrics to be generated",
64
+ "prompt_wav": "The path of the style prompt audio",
65
+ }
66
+ ```
67
+
68
+ One example can be refered to as: [example/test.jsonl](example/test.jsonl)
69
+
70
+ The prompt wav should be a 10-second, 48kHz audio clip.
71
+
72
+ The details about lyric format can be found in [docs/lyric_format.md](docs/lyric_format.md).
73
+
74
+ ### Inference
75
+
76
+ ```bash
77
+ source set_env.sh
78
+
79
+ python3 infer.py --input-jsonl example/test.jsonl
80
+
81
+ # For GPUs with low VRAM like RTX4090, you should set the dtype as bfloat16
82
+ python3 infer.py --input-jsonl example/test.jsonl --dtype bfloat16
83
+
84
+ # SongBloom also supports flash-attn (optional). To enable it, please install flash-attn (v2.6.3 is used during training) manually and set os.environ['DISABLE_FLASH_ATTN'] = "0" in infer.py:8
85
+ ```
86
+
87
+ ## Models
88
+
89
+ | Name | Size | Max Length | Prompt type | 🤗 |
90
+ |---|---|---|---|---|
91
+ | songbloom_full_150s | 2B | 2m30s | 10s wav | [link](https://huggingface.co/CypressYang/SongBloom) |
92
+ | ... | | | | |
93
+
94
+ ## Papers
95
+ * [Model Paper](https://huggingface.co/papers/2506.07634)
96
+ * [Github Repo](https://github.com/Cypress-Yang/SongBloom)
97
+
98
+ ## Citation
99
+
100
+ ```
101
+ @article{yang2025songbloom,
102
+ title={SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement},
103
+ author={Yang, Chenyu and Wang, Shuai and Chen, Hangting and Tan, Wei and Yu, Jianwei and Li, Haizhou},
104
+ journal={arXiv preprint arXiv:2506.07634},
105
+ year={2025}
106
+ }
107
+ ```