File size: 3,116 Bytes
d465146 f1c13ab d465146 f1c13ab becca7d f1c13ab | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 | ---
license: mit
language:
- en
base_model:
- Lightricks/LTX-2.3
pipeline_tag: video-to-video
tags:
- workflow,
- ltx,
- klein,
---
## Introduction
A comfyui workflow based on klein 9b and LTX 2.3 to render a shot based on a clay 3D render.
Shown example work with a car shot render.
## The workflow:
- generate a first frame and blend the car.
- generate a first LTX 2.3 pass with the IC-Lora
- generate a second pass with a injection of the 3d render. It allows to have a more accurate version of the car models.
## Model needed
### Base model
- Klein 9b
- LTX 2.3
### Lora
- [LTX-2.3-3DREAL-LoRA](https://huggingface.co/fal/LTX-2.3-3DREAL-LoRA)
- [Fusion Lora](https://civitai.com/models/2548669/image-blend-fusion-for-flux2-klein-4b-and-9b-edit)
### Comfyui custom node
- KJN nodes
- LTX nodes
- Video Helper Suite
- RES4LYF (Sampler on second pass, not necessary)
- NKD sigma curves (Adjust Sigma on second pass, not necessary)
```
┌────────────────┐ ┌────────────────────┐ ┌────────────┐ ┌──────────┐
│Crypto Car Mask │ │Clayrender + 3D car │ │ Background │ │Foreground│
└──────┬─────────┘ └─┬──────────┬───────┘ └──────┬─────┘ └──────┬───┘
│ │ │ │ Klein 9B │
│ │ │ │ │
│ │ │ └──── Blend + Fusion ───┘
│ │ │ LTX 2.3 │
│ │ │ │
│ │ └───IC-LORA 3DREAL ──────────────────────┘
│ │ │
└──────── Mask Car only ──────────► │
│
│
2nd render pass
│
│
Final render
``` |