WJM-George commited on
Commit
16ee018
·
verified ·
1 Parent(s): 3381165

Initial release

Browse files
Files changed (1) hide show
  1. README.md +6 -27
README.md CHANGED
@@ -1,8 +1,5 @@
1
  ---
2
  license: mit
3
- base_model:
4
- - Qwen/Qwen3.5-4B
5
- - Qwen/Qwen3.5-0.8B
6
  pipeline_tag: text-to-audio
7
  tags:
8
  - spatial-audio
@@ -20,10 +17,7 @@ Unified AMBIT supports native First-Order Ambisonics (FOA) generation and editin
20
  **text → AR → ScenePlan → DiT → FOA**. Editing additionally takes reference FOA audio.
21
  The AR-generated ScenePlan is used directly for rendering; no user-supplied plan is required.
22
 
23
- This release is the Unified 275k checkpoint. It continues the Unified 250k model
24
- for 25k updates after upgrading the AR request encoder to Qwen3.5-4B and expanding
25
- the ScenePlan output head. The renderer retains Qwen3.5-0.8B text conditioning.
26
- AR planning and DiT rendering share a Transformer backbone.
27
 
28
  ## Use
29
 
@@ -56,15 +50,7 @@ python -m ambit.infer edit --bundle models/AMBIT \
56
  --output outputs/edited.wav --seed 42
57
  ```
58
 
59
- Both commands save a float WAV and a JSON containing the generated ScenePlan.
60
- Audio is 44,100 Hz, four-channel ACN/SN3D FOA in W, Y, Z, X order. Editing accepts
61
- FOA clips up to 663,552 samples (about 15 seconds); mono and stereo are not accepted
62
- by this entry point. Use an ambisonic decoder for headphone playback.
63
-
64
- Default sampling: generation 100 Euler steps / CFG 3; editing 20 steps / CFG 1.
65
- The text request must fit 512 tokens and the generated plan supports up to four sources.
66
- Planning, verbatim speech and source preservation may be imperfect. This is a model
67
- release, not a claim of perfect instruction following or unchanged voice identity.
68
 
69
  ## Files
70
 
@@ -72,17 +58,10 @@ release, not a claim of perfect instruction following or unchanged voice identit
72
  - `vae.safetensors`: FOA audio encoder/decoder.
73
  - `bundle.json`, `renderer.json`, `vae.json`: inference configurations.
74
  - `codec/`: ScenePlan tokenization assets.
75
- - `planner_encoder/`, `text_encoder/`: frozen Qwen text encoders and tokenizers.
76
- - `SHA256SUMS`: artifact checksums.
77
-
78
- This is an inference export of the 275k checkpoint, not a resumable training checkpoint.
79
- It contains no optimizer state or training data. Use the AMBIT loader, not AutoModel
80
- on the root of this repository. The two Qwen subdirectories are encoder assets.
81
 
82
  ## License and attribution
83
 
84
- AMBIT code/weights are distributed under the repository MIT license. The included
85
- Qwen3.5-4B and Qwen3.5-0.8B text encoders and tokenizer assets retain their Apache-2.0
86
- licenses, included under `LICENSES/`. These are frozen text-encoder exports rather
87
- than complete vision/chat model packages. AMBIT builds on
88
- [stable-audio-tools](https://github.com/Stability-AI/stable-audio-tools).
 
1
  ---
2
  license: mit
 
 
 
3
  pipeline_tag: text-to-audio
4
  tags:
5
  - spatial-audio
 
17
  **text → AR → ScenePlan → DiT → FOA**. Editing additionally takes reference FOA audio.
18
  The AR-generated ScenePlan is used directly for rendering; no user-supplied plan is required.
19
 
20
+ One unified model supports both generation and editing. AR and DiT share the same Transformer backbone. All necessary model assets are included in the download.
 
 
 
21
 
22
  ## Use
23
 
 
50
  --output outputs/edited.wav --seed 42
51
  ```
52
 
53
+ Both commands save FOA audio and the generated ScenePlan. Editing uses a 44.1 kHz, four-channel ACN/SN3D FOA reference in W, Y, Z, X order.
 
 
 
 
 
 
 
 
54
 
55
  ## Files
56
 
 
58
  - `vae.safetensors`: FOA audio encoder/decoder.
59
  - `bundle.json`, `renderer.json`, `vae.json`: inference configurations.
60
  - `codec/`: ScenePlan tokenization assets.
61
+ - `planner_encoder/`, `text_encoder/`: text encoders and tokenizers.
 
 
 
 
 
62
 
63
  ## License and attribution
64
 
65
+ AMBIT is distributed under the MIT license. Included third-party components
66
+ retain their respective licenses; see `LICENSES/`.
67
+ AMBIT builds on [stable-audio-tools](https://github.com/Stability-AI/stable-audio-tools).