HAVING BAD RESULTS WITH DEV

#34
by Liquidmind111 - opened

DO i need to change the WF settings on PHASE 2 if i am using the DEV model? like MORE STEPS for upscale? CFG? image strenght?

@runedo you have DEV workflows already set?

If you're seeing jagged pixel-like edges, try changing the Upscale Method from 'Nearest-Exact' to 'Lanczos', this made my renders much better and edges look smoother. If you're seeing bright artifacts or titles at the end of the videos, that's a separate issue and not related to the workflows, You can check the discussions here https://huggingface.co/Lightricks/LTX-2.3/discussions/13

DO i need to change the WF settings on PHASE 2 if i am using the DEV model? like MORE STEPS for upscale? CFG? image strength?

PHASE 2 is always same, both for distilled and dev model workflows. This part only does the upscale part

If you use DEV model you need to enable the Distilled lora right below where you load the Dev model.
This makes it possible to run Dev model with low steps. The workflows are all made to run fast with low steps.

Alternatively if you want to run with more steps and cfg higher, you would need to change more but in PHASE 1:

  • at the first sampler pass group (phase 1), connect the LTX Sampler to the sigma input at the sampler
  • set steps to 20++ at this LTX Sampler at first pass group
  • Set CFG to 3-5 in the first pass group
  • Enable the distiller lora

The last part, the distilled lora is perhaps the most tricky part. It probably runs fine with the 0.6 strength set as default for both first and second pass (but it could in theory be far less for first pass, and 0.6 in last pass)

But if you wait a little bit I will upload a workflow soon, that runs Dev model for a more slow render with full steps, that can give better results

If you're seeing jagged pixel-like edges, try changing the Upscale Method from 'Nearest-Exact' to 'Lanczos',

Nice tip, will try that here. See if it improves things ;-)

DO i need to change the WF settings on PHASE 2 if i am using the DEV model? like MORE STEPS for upscale? CFG? image strength?

PHASE 2 is always same, both for distilled and dev model workflows. This part only does the upscale part

If you use DEV model you need to enable the Distilled lora right below where you load the Dev model.
This makes it possible to run Dev model with low steps. The workflows are all made to run fast with low steps.

Alternatively if you want to run with more steps and cfg higher, you would need to change more but in PHASE 1:

  • at the first sampler pass group (phase 1), connect the LTX Sampler to the sigma input at the sampler
  • set steps to 20++ at this LTX Sampler at first pass group
  • Set CFG to 3-5 in the first pass group
  • Enable the distiller lora

The last part, the distilled lora is perhaps the most tricky part. It probably runs fine with the 0.6 strength set as default for both first and second pass (but it could in theory be far less for first pass, and 0.6 in last pass)

But if you wait a little bit I will upload a workflow soon, that runs Dev model for a more slow render with full steps, that can give better results

But if i use the DEV model with NO lora, can i do 50 steps and is the same result as 20 steps WITH lora? i only had a good resullt with distilled LORA at 1..... 20 steps......, also, one pass WF with DEVm gives me bad result....... maybe because of the DIT cache i used.....

please let me kn ow ehen you get the DEV woekflow so i can compare what i am doing wrong...

If you're seeing jagged pixel-like edges, try changing the Upscale Method from 'Nearest-Exact' to 'Lanczos',

Nice tip, will try that here. See if it improves things ;-)

BOOM! ONE PASS workflow worked well, i removed the stupid DIT CACHE, and did 30 steps and lora at .6 and use deforum LTX lora and look!!!!! 20 seconds DEV in just 14 minutes!!!!
what do you think? 768x768

Yes that looks great ;-) Nice nice ;-)
Reminds me of the Deforum days.. I gotta try that lora ;-) got nostalgic hehe

And in a 2 pass workflow you can absolutely remove the lora from the 1st pass, and do 50 ish steps with dev model ONLY (and leave the dev + lora for 2nd pass upscale)
Its a little bit "complicated" since you bascially have "two models" in the spaghetti mess (And i have "hidden" a lot of spaghetti with get set nodes).
But if you know how to re-range it a bit, its not too hard. Just move the lora loader for the distilled lora away and put it into 2nd pass group. And connect the model "Get" node to that etc

That being said, i plan to make a Dev Model workflow though. For those who dont want to mess around with the nodes and noodles ;-)

Sign up or log in to comment