Workflow - IC Pose (control pose from ref video)

#46
by RuneXX - opened

I2V Control Pose - https://huggingface.co/RuneXX/LTX-2-Workflows/blob/main/LTX-2%20-%20I2V%20IC-Control%20(pose).json

The results vary a lot. Sometimes it looks really good, sometimes not.
And if your reference input image matches the pose of the first frame of the pose video, better results
but something to play around with ;-)

The reference image is a bit weak, so to speak. The resemblance is a bit lost. So consider this a WIP, will try see what can be done better ;-)

UPDATE:
Found something that improved the resemblance from the input image.
Should work better now ;-)

sweet

Works ok for dance videos too ;-)
As long as not too crazy or too fast movements

And also added an All-In-One IC Lora control workflow that works for both I2V and T2V
I2V & T2V (pose, canny & depth) : https://huggingface.co/RuneXX/LTX-2-Workflows/blob/main/LTX-2%20-%20I2V%20and%20T2V%20IC-Control%20(All-In-One%20Pose%20Canny%20Depth).json
(its a little bit "complicated" or crowded, so if you just want to try pose, better to just get the pose workflow in first post above)

useless, face is distorting

Probably just turn off the face in the pose skeleton, and use more steps ;-)
But yes, from my own test runs, it works best with slow motions, less so with dance videos

Sign up or log in to comment