Workflow : I2V & T2V - transfer body movements from reference video with IC-RealisDance lora

#129
by RuneXX - opened

I2V & T2V - transfer body movements from reference video with IC-RealisDance lora

A nice alternative to the LTX Ic-Control lora many is probably familiar with.
And it uses a video input to drive the body movements, and a reference image to transfer the pose to.
Can often give more "natural" results, and less forcing the frame to change to adapt to the pose input.

LTX seems to work best with close up and not too fast motions, so might not do the most crazy tik-tok routines ;-)
(or you can try more steps, dev model, or even single pass if trying more "crazy" stuff)

In the workflow you can choose between LTX audio, custom audio input, or using the audio from the input video.
And the workflow has an easy toggle to choose between DW Pose and SD Pose.

For the lora, download the RealisDance here : https://huggingface.co/Kijai/LTX2-IC-LoRAs

Feel free to play around with it ;-)
https://huggingface.co/RuneXX/LTX-2.3-Workflows/tree/main/Control-reference

RuneXX changed discussion title from I2V & T2V - transfer body movements from reference video with IC-RealisDance lora to Workflow : I2V & T2V - transfer body movements from reference video with IC-RealisDance lora

Sign up or log in to comment