| --- |
| license: mit |
| language: |
| - en |
| base_model: |
| - Lightricks/LTX-2.3 |
| pipeline_tag: video-to-video |
| tags: |
| - workflow, |
| - ltx, |
| - klein, |
| --- |
| |
|
|
| ## Introduction |
|
|
| A comfyui workflow based on klein 9b and LTX 2.3 to render a shot based on a clay 3D render. |
| Shown example work with a car shot render. |
|
|
|
|
|  |
|
|
|
|
| ## The workflow: |
| - generate a first frame and blend the car. |
| - generate a first LTX 2.3 pass with the IC-Lora |
| - generate a second pass with a injection of the 3d render. It allows to have a more accurate version of the car models. |
|
|
|
|
| ## Model needed |
| ### Base model |
| - Klein 9b |
| - LTX 2.3 |
| ### Lora |
| - [LTX-2.3-3DREAL-LoRA](https://huggingface.co/fal/LTX-2.3-3DREAL-LoRA) |
| - [Fusion Lora](https://civitai.com/models/2548669/image-blend-fusion-for-flux2-klein-4b-and-9b-edit) |
| ### Comfyui custom node |
| - KJN nodes |
| - LTX nodes |
| - Video Helper Suite |
| - RES4LYF (Sampler on second pass, not necessary) |
| - NKD sigma curves (Adjust Sigma on second pass, not necessary) |
|
|
|
|
| ``` |
| ┌────────────────┐ ┌────────────────────┐ ┌────────────┐ ┌──────────┐ |
| │Crypto Car Mask │ │Clayrender + 3D car │ │ Background │ │Foreground│ |
| └──────┬─────────┘ └─┬──────────┬───────┘ └──────┬─────┘ └──────┬───┘ |
| │ │ │ │ Klein 9B │ |
| │ │ │ │ │ |
| │ │ │ └──── Blend + Fusion ───┘ |
| │ │ │ LTX 2.3 │ |
| │ │ │ │ |
| │ │ └───IC-LORA 3DREAL ──────────────────────┘ |
| │ │ │ |
| └──────── Mask Car only ──────────► │ |
| │ |
| │ |
| 2nd render pass |
| │ |
| │ |
| |
| Final render |
| ``` |
