Multiguide Node Query

#81
by earth007 - opened

Hey Phr00t,

I was wondering if it is possible to use more than first frame and last frame, and used about 3-4 images to guide movement for 12V. If so, what would you change in your workflow ? I attempted to add a 3rd image as the middle frame, connected the resize nodes, set the strength at 0.5 and set the frame index for the middle image, but the video came out all messed up with the last few frames going all spastic. lol. Also, is it possible to add custom audio to your example workflow? I am good with tinkering wan, sdxl and qwen workflows, but the ltx2 makes my head spin. lol. Any tips would be highly appreciated. Also, it was heartbreaking to hear you retiring from the scene, you are the goat. Thank you, Phr00t.

It should be pretty easy to add more images. Increase the "number of guides" value in the LTXAddGuides node. That should make more image inputs appear. Make sure you set the frame index appropriate for each image. Make sure you generate enough frames to give LTX enough room to reach each guide image.

I haven't messed with custom audio myself, and from what I hear, it is tricky to get working with my workflow (and I don't think anyone figured out why). Theoretically you should be able to use a VAE Encode with the Audio VAE, and then have a "mask" of 0 node applied to the latent (if I recall correctly)... but I think people just weren't getting it working. :(

Also, thank you for the kind words! I've been getting stretched really thin maintaining models, handling feedback and trying to do "the right thing" for everyone who uses my stuff. I really thank the community for their great support!

It should be pretty easy to add more images. Increase the "number of guides" value in the LTXAddGuides node. That should make more image inputs appear. Make sure you set the frame index appropriate for each image. Make sure you generate enough frames to give LTX enough room to reach each guide image.

Yeah, I did try that yesterday while making a 185 frame clip at 24fps. Set the strength of the first image at one and index at 0, strength of the 2nd one at 0.5 and frame index at 92 and the last image at 1 strength and frame index at -1. The clip played smoothly from frame 0 to 92, then from 92 to last frame, it just became weird and stretched out, even though I resized all three images to the same resolution. I will try again. May be my prompting needs to be more refined. Thank you, Phr00t.

I haven't messed with custom audio myself, and from what I hear, it is tricky to get working with my workflow (and I don't think anyone figured out why). Theoretically you should be able to use a VAE Encode with the Audio VAE, and then have a "mask" of 0 node applied to the latent (if I recall correctly)... but I think people just weren't getting it working. :(

@Phr00t Use this at least for me works great with your workflow i have changed only the sampler and attached the custom audio part.

https://pastebin.com/DmemYrYD

Sign up or log in to comment