Instructions to use JackIsNotInTheBox/Generate_Audio_for_Video_Checkpoints with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use JackIsNotInTheBox/Generate_Audio_for_Video_Checkpoints with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("JackIsNotInTheBox/Generate_Audio_for_Video_Checkpoints", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Commit History
-
Mirror weights/mmaudio_small_44k.pth from hkchengrex/MMAudio@eb13a1a9
Verified signaturef0ba17a -
Mirror weights/mmaudio_small_16k.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature7f40a21 -
Mirror weights/mmaudio_medium_44k.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature5d66932 -
Mirror weights/mmaudio_large_44k_v2.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature9b2b500 -
Mirror weights/mmaudio_large_44k.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature3be171e -
Mirror ext_weights/v1-44.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature2696969 -
Mirror ext_weights/v1-16.pth from hkchengrex/MMAudio@eb13a1a9
Verified signatureb19717b -
Mirror ext_weights/synchformer_state_dict.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature264683f -
Mirror ext_weights/best_netG.pt from hkchengrex/MMAudio@eb13a1a9
Verified signaturef8a2b9f -
Mirror examples/sora_serpent.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signatureb22140f -
Mirror examples/sora_seahorse.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturea619da6 -
Mirror examples/sora_nyc.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturee6a6666 -
Mirror examples/sora_kraken.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signatureb48d131 -
Mirror examples/sora_india.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signature683faf6 -
Mirror examples/sora_galloping.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signature18cd146 -
Mirror examples/sora_beach.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturef8746e8 -
Mirror examples/mochi_storm.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signature75091fe -
Mirror examples/hunyuan_wake_up.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturee88efb0 -
Mirror examples/hunyuan_typing.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturead8a181 -
Mirror examples/hunyuan_spring.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signatureb10da14 -
Mirror checkpoints/mmaudio_small_44k_ckpt.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature021030a -
Mirror checkpoints/mmaudio_small_16k_ckpt.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature4c02d44 -
Mirror checkpoints/mmaudio_medium_44k_ckpt.pth from hkchengrex/MMAudio@eb13a1a9
Verified signaturefaf3d16 -
Mirror checkpoints/mmaudio_large_44k_ckpt.pth from hkchengrex/MMAudio@eb13a1a9
Verified signatured4a682d -
Mirror README.md from hkchengrex/MMAudio@eb13a1a9
Verified signature91cf36d