Instructions to use mlx-community/ACE-Step-1.5-text-encoder-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/ACE-Step-1.5-text-encoder-bf16 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/ACE-Step-1.5-text-encoder-bf16 --local-dir ACE-Step-1.5-text-encoder-bf16
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
mlx-community/ACE-Step-1.5-text-encoder-bf16
ACE-Step 1.5 text encoder (Qwen3-Embedding-0.6B) — MLX, bf16. Converted from ACE-Step/Ace-Step1.5 @ 19671f4 by the converter of
xocialize/mlx-ace-step-swift (Tools/convert/convert.py, mlx 0.32.4), a full
port of ace-step/ACE-Step-1.5 @ ca1e85f to Swift-MLX.
What is in the bundle
The Qwen3-Embedding-0.6B checkpoint ACE-Step 1.5 ships as its text encoder (the caption prompt's last hidden states and the
lyric embedding table), in mlx-lm's model.* layout with the tokenizer files — the released checkpoint is a bare Qwen3Model
that mlx_lm.convert cannot read, which is why it is published under the ACE-Step name rather than as a community conversion
of the Qwen repo (a differently laid-out conversion would not load into the package). 310 tensors, bit-equal to the checkpoint.
Licence
Apache-2.0 (Qwen). Redistributed unmodified beyond the layout conversion; the ACE-Step 1.5 pipeline that consumes it is MIT.
The full notice travels with the bundle as NOTICE; LICENSE is the MIT text. Nothing in the weights is modified beyond the
layout conversion (key prefix / conv layout / weight-norm folding) — the converter Tools/convert/convert.py in
xocialize/mlx-ace-step-swift is gated bit-equal against upstream's own
dit_convert.py / vae_convert.py (its MEASUREMENTS.md §V1).
Use
Every tier of the Swift package loads four bundles — the turbo DiT, one planner, the text encoder and the VAE — and this bundle
is one of them. The planner choices: ACE-Step-1.5-planner-1.7B-8bit for .int8 (the default), -4bit for .int4, -bf16 for
.bf16 / .fp32, and ACE-Step-1.5-planner-0.6B-bf16 for the lite planner on any tier. The package,
xocialize/mlx-ace-step-swift, runs ACE-Step 1.5 on Apple Silicon through
MLX Swift and plugs into MLXEngine on the
music capability (caption + lyrics → a 48 kHz stereo song; reference-audio timbre; cover / repaint / extend of a source clip;
LRC timestamps). The package's ACEStepConfiguration names these repos and the engine materialises them; the parity gates
against the upstream oracle (fp32, TF32 off) are recorded in the package's MEASUREMENTS.md.
let engine = MLXServeEngine()
let id = try await engine.register(ACEStepPackage.registration, configuration: ACEStepConfiguration()) // the .int8 default
try await engine.prepare(.music, package: id)
let song = try await engine.run(MusicRequest(caption: "…", lyrics: "[Verse]\n…", durationSeconds: 120, seed: 7), package: id)
Upstream: ACE-Step/Ace-Step1.5 @ 19671f4 (weights),
ace-step/ACE-Step-1.5 @ ca1e85f (code) — ACE Studio + StepFun,
tech report.
- Downloads last month
- 82
Quantized