Add audio-to-audio pipeline tag and fix markdown links
#2
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# UniSE: A Unified Framework for Decoder-only Autoregressive LM-based Speech Enhancement
|
| 2 |
|
| 3 |
<p align="center">
|
|
@@ -26,7 +30,7 @@
|
|
| 26 |
- π **End-to-End Compatible**: Integrates WavLM (feature extractor), BiCodec (discrete codec), and LM into one pipeline.
|
| 27 |
- π **Multitask Support**: SE, SR, TSE, SS, and more β all in a single model.
|
| 28 |
|
| 29 |
-
π **Paper**: [arXiv:2510.20441](https://arxiv.org/abs/2510.20441) | π€ **Model**: [Hugging Face
|
| 30 |
|
| 31 |
---
|
| 32 |
|
|
@@ -72,7 +76,7 @@ Additionally, download WavLM-Large.pt from this [URL](https://huggingface.co/mic
|
|
| 72 |
|
| 73 |
Alternatively, you can download them manually and place them in the `./model/bicodec/` directory.
|
| 74 |
|
| 75 |
-
|
| 76 |
|
| 77 |
## Train
|
| 78 |
+ Quick start
|
|
@@ -90,6 +94,7 @@ python ./train.py --config conf/config.yaml
|
|
| 90 |
| `rir_scp_path` | SCP of rir audio files |
|
| 91 |
| `mode` | Task type: `se` (Noise Suppression,Speech Restoration,Packet Loss Concealment), `tse` (Target Speaker Extraction), `SS` (Speech Separation). |
|
| 92 |
|
|
|
|
| 93 |
|
| 94 |
## Inference
|
| 95 |
+ Quick start
|
|
@@ -116,6 +121,7 @@ Command to run inference:
|
|
| 116 |
python test.py
|
| 117 |
```
|
| 118 |
|
|
|
|
| 119 |
|
| 120 |
## Model Checkpoints
|
| 121 |
|
|
@@ -139,7 +145,5 @@ Our approach focuses on leveraging the LLM's comprehension capabilities to enabl
|
|
| 139 |
}
|
| 140 |
```
|
| 141 |
|
| 142 |
-
|
| 143 |
## Contact
|
| 144 |
-
For any questions, please contact: `yanhaoyin.yhy@alibaba-inc.com`
|
| 145 |
-
|
|
|
|
| 1 |
+
---
|
| 2 |
+
pipeline_tag: audio-to-audio
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
# UniSE: A Unified Framework for Decoder-only Autoregressive LM-based Speech Enhancement
|
| 6 |
|
| 7 |
<p align="center">
|
|
|
|
| 30 |
- π **End-to-End Compatible**: Integrates WavLM (feature extractor), BiCodec (discrete codec), and LM into one pipeline.
|
| 31 |
- π **Multitask Support**: SE, SR, TSE, SS, and more β all in a single model.
|
| 32 |
|
| 33 |
+
π **Paper**: [arXiv:2510.20441](https://arxiv.org/abs/2510.20441) | π€ **Model**: [Hugging Face](https://huggingface.co/QuarkAudio/QuarkAudio-UniSE/)
|
| 34 |
|
| 35 |
---
|
| 36 |
|
|
|
|
| 76 |
|
| 77 |
Alternatively, you can download them manually and place them in the `./model/bicodec/` directory.
|
| 78 |
|
| 79 |
+
---
|
| 80 |
|
| 81 |
## Train
|
| 82 |
+ Quick start
|
|
|
|
| 94 |
| `rir_scp_path` | SCP of rir audio files |
|
| 95 |
| `mode` | Task type: `se` (Noise Suppression,Speech Restoration,Packet Loss Concealment), `tse` (Target Speaker Extraction), `SS` (Speech Separation). |
|
| 96 |
|
| 97 |
+
---
|
| 98 |
|
| 99 |
## Inference
|
| 100 |
+ Quick start
|
|
|
|
| 121 |
python test.py
|
| 122 |
```
|
| 123 |
|
| 124 |
+
---
|
| 125 |
|
| 126 |
## Model Checkpoints
|
| 127 |
|
|
|
|
| 145 |
}
|
| 146 |
```
|
| 147 |
|
|
|
|
| 148 |
## Contact
|
| 149 |
+
For any questions, please contact: `yanhaoyin.yhy@alibaba-inc.com`
|
|
|