File size: 2,359 Bytes
9cd04d4 89d24b4 9cd04d4 89d24b4 9cd04d4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 | ---
base_model: Qwen/Qwen3-VL-8B-Instruct
license: other
license_name: acoustitrace-rt60-research-license
license_link: https://huggingface.co/Missouter/AcoustiTrace-RT60/blob/main/LICENSE
tags:
- acoustitrace
- audio-visual
- room-acoustics
- rt60
- lora
---
# AcoustiTrace RT60 Evaluator
This repository contains the learned visual RT60 component used by
[AcoustiTrace](https://leader-sheng.github.io/AcoustiTrace/), an audio-visual
benchmark for diagnosing acoustic plausibility in generated videos.
The checkpoint estimates scene-consistent reverberation time at 500 Hz from
visual acoustic cues. It contains a LoRA adapter for
[`Qwen/Qwen3-VL-8B-Instruct`](https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct)
and a Sabine-guided continuous physics head. It does **not** include a copy of
the Qwen3-VL base model.
## Files
```text
physics_head.pt
vlm_adapter/
adapter_config.json
adapter_model.safetensors
processor/
acoustitrace_rt60_config.json
SHA256SUMS
```
## Use with AcoustiTrace
```bash
git clone https://github.com/Leader-sheng/AcoustiTrace.git
cd AcoustiTrace
python scripts/download_weights.py \
--repo-id Missouter/AcoustiTrace-RT60 \
--local-dir checkpoints/acoustitrace-rt60
python scripts/verify_checkpoint.py checkpoints/acoustitrace-rt60
```
The frozen base model is downloaded separately from
`Qwen/Qwen3-VL-8B-Instruct`. Full evaluator setup and end-to-end commands are
provided in the AcoustiTrace repository.
## Training sources and license
The RT60 supervision combines Matterport3D RGB-D observations, SoundSpaces 2.0
room-acoustic simulation, and absorption coefficients from the PTB Room
Acoustics Absorption Coefficient Database. No upstream training data is
included in this repository.
The model artifacts are available for non-commercial academic and research
use under the terms in [LICENSE](LICENSE). In particular, use remains subject
to the Matterport3D Academic Use Terms. The Qwen3-VL base model is separately
licensed under Apache-2.0.
## Links
- [Paper](https://arxiv.org/abs/2608.02035)
- [Project page](https://leader-sheng.github.io/AcoustiTrace/)
- [Code](https://github.com/Leader-sheng/AcoustiTrace)
## Scope
This model is released as the visual RT60 evaluator for AcoustiTrace. Its
outputs are diagnostic estimates for benchmark evaluation rather than direct
room-acoustic measurements.
|