Workflow: T2V R2V Character Sheet with Best Face ID Lora

#187
by RuneXX - opened

T2V R2V Character Sheet with Best Face ID Lora

Create consistent character videos from a character sheet and use T2V prompts to set the scene, action and motion with the new loras from @Alissonerdx

Strongly suggested to read the guide on Best Face ID lora repro for tips and tricks, and requirements to image inputs
The lora is a bit new, so might be some changes to workflow. But feel free to experiment with the lora strength, and use with or without the extra face id only lora for 2nd pass.

Get the lora here: https://huggingface.co/Alissonerdx/LTX-Best-Face-ID (face id character sheet + face id lora)
Get the BFS node here: https://github.com/alisson-anjos/ComfyUI-BFSNodes

Helper Workflow to create character sheet: https://huggingface.co/RuneXX/LTX-2.3-Workflows/tree/main/Multi-ref-character-sheet/Helper-wf
(or you can use chatGPT, Nano Banana etc with the prompt instructions here: https://huggingface.co/Alissonerdx/LTX-Best-Face-ID/blob/main/character_sheet_prompt.md )

Try out workflow here:
https://huggingface.co/RuneXX/LTX-2.3-Workflows/tree/main/Multi-ref-character-sheet

(a face id only workflow coming asap.. you can also try out workflows here https://huggingface.co/Alissonerdx/LTX-Best-Face-ID/tree/main/workflows )

How do I combine with background and another character?

How do I combine with background and another character?

out of the box this is a single character lora.
But was intending to try see if i could "hack" that, since the lora is more capable that it might first seem (you can even use regular i2v with the lora etc). Will try some experiments

For now, if you want to combine background and another character, perhaps look into LTX-Ingredients lora instead or the MSR-2 (Multi-Subject Reference lora).
Might even be possible to combine but i havent tried that

This comment has been hidden (marked as Spam)

What about the sampler? Try use the euler_ancestral_cfg in first pass, and the manual sigmas.

image

default from workflow.. ok I'll try change to euler_ancestral_cfg_pp now, then update the result here again.

no that seems fine. 2nd pass works good with euler_cfg_pp

In the FIRST pass, check if its euler_ancestral_cfg_pp there. And manual sigma.
(i'll download the wf too. Sometimes i leave it at Basic Scheduler, so its ready for more steps, but since you are on distilled model, manual sigma and euler_ancestral_cfg_pp is more proven to usually be good)

and all seems fine from the screens. Will run some test here also. LTX is a bit soft (And euler too), but perhaps not as much as your output

image
the first pass in default no changes anything

This comment has been hidden (marked as Spam)

the first pass in default no changes anything

yes thats default LTX. So thats all ok. ;-)
will try the wf just to see what it could be

Yeeaaay it's time to move to Minimax H3 and delete everything about LTX2.3 :)

Sign up or log in to comment