torchvision>=0.26 (auto-installed alongside torch 2.11.0) removed the
public read_video/write_video API entirely from torchvision.io in OSS
builds, breaking TARO onset extraction with ImportError. av (PyAV) was
already a pinned dependency, so decode frames directly with it instead.
Remove non-inference files from all three model folders
Jack Wu
22b2290
Keep only what is imported at runtime by app.py:
- TARO: remove dataset.py, infer.py, loss.py, train.py, train.sh, preprocess/, README.md
- MMAudio: remove train.py, batch_eval.py, eval_onsets.py, demo.py, gradio_demo.py,
config/, docs/, sets/, training/, README.md, LICENSE, .gitignore
- HunyuanFoley: remove infer.py, gradio_app.py, tests/, assets/, build_package.sh,
download_test_videos.sh, DEVELOPMENT.md, INSTALL.md, LICENSE, MANIFEST.in,
NOTICE, pytest.ini, README.md, .gitattributes, .gitignore, .pre-commit-config.yaml
Update .gitignore to permanently exclude all of the above.
.
Jack Wu
c60109f
Restructure app.py: multi-model support (TARO, MMAudio, HunyuanFoley)
Jack Wu
6cf4573
- Split into three tabbed UI sections, one per model
- Updated checkpoint repo/folder paths to JackIsNotInTheBox/Generate_Audio_for_Video_Checkpoints
with TARO/, MMAudio/, HunyuanFoley/ subfolders
- TARO: preserve exact infer.py invocation (CAVP+VideoOnsetNet+MMDiT+AudioLDM2 decoder)
with sliding-window segmentation; fix samplers tuple return indexing
- MMAudio: use official load_video()+generate() pipeline from gradio_demo.py;
override model paths to our HF checkpoint repo; large_44k_v2 variant
- HunyuanFoley: use official load_model()+feature_process()+denoise_process()
pipeline; batch inference for multiple samples; xl/xxl size selector
- Add model-specific optimal duration constants from source configs
- Shared slot UI helper; MAX_SLOTS=8 maintained across all tabs
