Instructions to use declare-lab/tango with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use declare-lab/tango with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-audio", model="declare-lab/tango")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("declare-lab/tango", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
07664ba
1
Parent(s): fd78313
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,9 +7,9 @@ language:
|
|
| 7 |
---
|
| 8 |
# TANGO: Text to Audio using iNstruction-Guided diffusiOn
|
| 9 |
|
| 10 |
-
**TANGO** is a latent diffusion model for text
|
| 11 |
|
| 12 |
-
📣 We are
|
| 13 |
|
| 14 |
## Code
|
| 15 |
|
|
|
|
| 7 |
---
|
| 8 |
# TANGO: Text to Audio using iNstruction-Guided diffusiOn
|
| 9 |
|
| 10 |
+
**TANGO** is a latent diffusion model for text-to-audio generation. **TANGO** can generate realistic audios including human sounds, animal sounds, natural and artificial sounds and sound effects from textual prompts. We use the frozen instruction-tuned LLM Flan-T5 as the text encoder and train a UNet based diffusion model for audio generation. We outperform current state-of-the-art models for audio generation across both objective and subjective metrics. We release our model, training, inference code and pre-trained checkpoints for the research community.
|
| 11 |
|
| 12 |
+
📣 We are releasing [**Tango-Full-FT**](https://huggingface.co/declare-lab/tango-full-ft) which was first pre-trained on [**TangoPromptBank**](https://huggingface.co/datasets/declare-lab/TangoPromptBank), a collection of diverse text, audio pairs. We later fine tuned this checkpoint on AudioCaps. This checkpoint obtained state-of-the-art results for text-to-audio generation on AudioCaps.
|
| 13 |
|
| 14 |
## Code
|
| 15 |
|