File size: 2,091 Bytes
f47b802 eb41300 f47b802 eb41300 f3ed57c eb41300 16ee018 eb41300 16ee018 eb41300 16ee018 eb41300 16ee018 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 | ---
license: mit
pipeline_tag: text-to-audio
tags:
- spatial-audio
- ambisonics
- audio-editing
- transfusion
language:
- en
---
# AMBIT model checkpoint
[Code and instructions](https://github.com/WJM-George/AMBIT) · [Demo](https://wjm-george.github.io/AMBIT/) · [Paper](https://arxiv.org/abs/2610.34415)
AMBIT supports text-guided First-Order Ambisonics (FOA) generation and editing. Editing additionally takes reference FOA audio.
One unified model supports both generation and editing. AR and DiT share the same Transformer backbone. All necessary model assets are included in the download.
## Use
Requires Python 3.10+, Linux, and a CUDA GPU with bfloat16 support.
Install the matching inference code, then download this repository:
```bash
git clone https://github.com/WJM-George/AMBIT.git
cd AMBIT
python3 -m venv .venv
source .venv/bin/activate
python -m pip install -e .
hf download WJM-George/AMBIT --local-dir models/AMBIT
```
Generation:
```bash
python -m ambit.infer generate --bundle models/AMBIT \
--prompt "A dog barks to the left while a car passes from front to right." \
--output outputs/generated.wav --seed 42
```
Editing:
```bash
python -m ambit.infer edit --bundle models/AMBIT \
--source input_foa.wav \
--prompt "Move the dog to the right while keeping the other sounds unchanged." \
--output outputs/edited.wav --seed 42
```
Both commands save FOA audio and the generated ScenePlan. Editing uses a 44.1 kHz, four-channel ACN/SN3D FOA reference in W, Y, Z, X order.
## Files
- `model.safetensors`: shared Transformer, AR head, conditioning and AMBIT CLAP weights.
- `vae.safetensors`: FOA audio encoder/decoder.
- `bundle.json`, `renderer.json`, `vae.json`: inference configurations.
- `codec/`: ScenePlan tokenization assets.
- `planner_encoder/`, `text_encoder/`: text encoders and tokenizers.
## License and attribution
AMBIT is distributed under the MIT license. Included third-party components
retain their respective licenses; see `LICENSES/`.
AMBIT builds on [stable-audio-tools](https://github.com/Stability-AI/stable-audio-tools).
|