--- library_name: transformers license: mit pipeline_tag: text-to-audio tags: - audio - music - text2music - demodokos ---

Demodokos Foundry

Demos Features Pricing Download

Local AI music, speech, editing, mixing, and automation

Your GPU is the studio.

Generate music, create lifelike speech, clone voices, separate stems, repair sections, record, mix, master, and automate full audio workflows. Foundry runs locally on Windows with an NVIDIA GPU, so your scripts, voices, songs, and client audio stay on your machine.

Download for Windows Start free trial Hear examples

No cloud generation / No credit meters / Voice cloning included / Built for private production

50+

Music languages

10

Speech languages

50 x 5

Emotion control

200+

DSP presets

120+

Commands

Music

Songs, vocals, structure, style, and language control.

Create full tracks, extend ideas, transform references, patch weak sections, and generate multilingual songs locally.

Compare music generators

Speech

Expressive narration that does not sound like filler.

Generate speech in 10 languages, direct emotion line by line, clone voices from short samples, and build multi-speaker scenes.

Explore local AI voice

Studio

A real production workspace, not just a prompt field.

Record, arrange, stem-split, patch, crossfade, process with DSP, mix on a DAW-style timeline, and export final audio.

See what is inside

Local creative agent

Give the boring preparation work to the assistant.

Use the built-in agent for lyrics, music briefs, script preparation, speaker extraction, emotion planning, literature summaries, narration segmentation, batch workflows, and repeatable production tasks.

foundry analyze manuscript.pdf
foundry extract speakers and emotions
foundry generate narration
foundry compose intro music
foundry mix and export

Pick your workflow

YouTubers and faceless channels

Voiceovers, hooks, background music, repeatable production, no per-video credit anxiety.

Game developers

NPC dialogue, character voices, batch generation, ambience, score, and engine-ready export.

Audiobooks and podcasts

Long-form narration, multi-speaker scenes, private manuscripts, music beds, and final export.

Speech studios by language

English Deutsch Français Español Italiano 中文日本語 Русский Português 한국어

Learn fast

Getting started Emotion manager Patching Creative AI agent

Deep dives

Voice cloning ElevenLabs alternative Automation Privacy

## Model This model is hosted for Demodokos Foundry but it can be used for other purposes, enjoy a stable download location and custom quantizations not available elsewhere. ## Model Details 🚀 **ACE-Step v1.5** is a highly efficient open-source music foundation model designed to bring commercial-grade music generation to consumer hardware. ### Key Features * **💰 Commercial-Ready:** Unlike many models trained on ambiguous datasets, ACE-Step v1.5 is designed for creators. You can strictly use the generated music for **commercial purposes**. * **📚 Safe & Robust Training Data:** The model is trained on a massive, legally compliant dataset consisting of: * **Licensed Data:** Professionally licensed music tracks. * **Royalty-Free / No-Copyright Data:** A vast collection of public domain and royalty-free music. * **Synthetic Data:** High-quality audio generated via advanced MIDI-to-Audio conversion. * **⚡ Extreme Speed:** Generates a full song in under 2 seconds on an A100 and under 10 seconds on an RTX 3090. * **🖥️ Consumer Hardware Friendly:** Runs locally with less than 4GB of VRAM. ### Technical Capabilities 🌉 At its core lies a novel hybrid architecture where the Language Model (LM) functions as an omni-capable planner: it transforms simple user queries into comprehensive song blueprints—scaling from short loops to 10-minute compositions—while synthesizing metadata, lyrics, and captions via Chain-of-Thought to guide the Diffusion Transformer (DiT). ⚡ Uniquely, this alignment is achieved through intrinsic reinforcement learning relying solely on the model's internal mechanisms, thereby eliminating the biases inherent in external reward models or human preferences. 🎚️ 🔮 Beyond standard synthesis, ACE-Step v1.5 unifies precise stylistic control with versatile editing capabilities—such as cover generation, repainting, and vocal-to-BGM conversion—while maintaining strict adherence to prompts across 50+ languages. This paves the way for powerful tools that seamlessly integrate into the creative workflows of music artists, producers, and content creators. 🎸 - **Developed by:** [ACE-STEP] - **Model type:** [Text2Music] - **Language(s):** [50+ languages] - **License:** [MIT] ## Evaluation ![image](https://cdn-uploads.huggingface.co/production/uploads/62dfaf90c42558bcbd0a4f6f/n9aKi_NhSmlMOgmGzahZi.png) ## 🏗️ Architecture ![image](https://cdn-uploads.huggingface.co/production/uploads/62dfaf90c42558bcbd0a4f6f/V_d1rTdqkQyoSM8td7OWl.png) ## 🦁 Model Zoo ![image](https://cdn-uploads.huggingface.co/production/uploads/62dfaf90c42558bcbd0a4f6f/B49V0OTKse_FRefTmTPsQ.png) ### DiT Models | DiT Model | Pre-Training | SFT | RL | CFG | Step | Refer audio | Text2Music | Cover | Repaint | Extract | Lego | Complete | Quality | Diversity | Fine-Tunability | Hugging Face | |-----------|:------------:|:---:|:--:|:---:|:----:|:-----------:|:----------:|:-----:|:-------:|:-------:|:----:|:--------:|:-------:|:---------:|:---------------:|--------------| | `acestep-v15-base` | ✅ | ❌ | ❌ | ✅ | 50 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Medium | High | Easy | [Link](https://huggingface.co/ACE-Step/acestep-v15-base) | | `acestep-v15-sft` | ✅ | ✅ | ❌ | ✅ | 50 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | High | Medium | Easy | [Link](https://huggingface.co/ACE-Step/acestep-v15-sft) | | `acestep-v15-turbo` | ✅ | ✅ | ❌ | ❌ | 8 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | Very High | Medium | Medium | [Link](https://huggingface.co/ACE-Step/Ace-Step1.5) | | `acestep-v15-turbo-rl` | ✅ | ✅ | ✅ | ❌ | 8 | ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | Very High | Medium | Medium | To be released | ### LM Models | LM Model | Pretrain from | Pre-Training | SFT | RL | CoT metas | Query rewrite | Audio Understanding | Composition Capability | Copy Melody | Hugging Face | |----------|---------------|:------------:|:---:|:--:|:---------:|:-------------:|:-------------------:|:----------------------:|:-----------:|--------------| | `acestep-5Hz-lm-0.6B` | Qwen3-0.6B | ✅ | ✅ | ✅ | ✅ | ✅ | Medium | Medium | Weak | ✅ | | `acestep-5Hz-lm-1.7B` | Qwen3-1.7B | ✅ | ✅ | ✅ | ✅ | ✅ | Medium | Medium | Medium | ✅ | | `acestep-5Hz-lm-4B` | Qwen3-4B | ✅ | ✅ | ✅ | ✅ | ✅ | Strong | Strong | Strong | ✅ | ## 🙏 Acknowledgements This project is co-led by ACE Studio and StepFun. ## 📖 Citation If you find this project useful for your research, please consider citing: ```BibTeX @misc{gong2026acestep, title={ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generation}, author={Junmin Gong, Yulin Song, Wenxiao Zhao, Sen Wang, Shengyuan Xu, Jing Guo}, howpublished={\url{https://github.com/ace-step/ACE-Step-1.5}}, year={2026}, note={GitHub repository} }