Workflow : I2V & T2V with Custom Audio
I2V & T2V - With Custom Audio
https://huggingface.co/RuneXX/LTX-2.3-Workflows/tree/main
Use your own audio files with lip sync, and synced motion
(was quite surprised how well the drummer syncs to the drum input solo .. ;-))
THAT DRUMMER SYNCED TO CUSTOM AUDIO?! No way.. I thought that was impossible! Now I know what I'm doing today.
THAT DRUMMER SYNCED TO CUSTOM AUDIO?! No way.. I thought that was impossible! Now I know what I'm doing today.
Sure is ;-) from a drum solo audio file
Here is the audio source : https://www.youtube.com/watch?v=kFjrZzbMhp8
Just grabbed that audio to use as example ;-)
Mel Band has a instrument isolating node that you can plugin after splitting vocals. Going to test that now.
I could never get this image to audio working with LTX 2.0 or WAN 2.1. But it finally worked.
That looks awesome ;-) lip-sync, but also camera and body language. Even has light flair from the lights behind.. LTX-2 surprises me all the time ;-)
Wan got plenty of good sides as well, lots of fun experiments with that.
But LTX-2 is for sure a bit of a jack-of-all-trades magic in a box ;-) hehe
Not bad!
Yeah its quite surprising it understands music ;-)
Already made it better, this is nuts! I can't believe its possible.