Felox commited on
Commit
f1c13ab
Β·
verified Β·
1 Parent(s): d465146

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md CHANGED
@@ -1,3 +1,61 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Lightricks/LTX-2.3
7
+ pipeline_tag: video-to-video
8
+ tags:
9
+ - workflow,
10
+ - ltx,
11
+ - klein,
12
  ---
13
+
14
+
15
+ ## Introduction
16
+
17
+ A comfyui workflow based on klein 9b and LTX 2.3 to render a shot based on a clay 3D render.
18
+ Shown example work with a car shot render.
19
+
20
+
21
+ ## The workflow:
22
+ - generate a first frame and blend the car.
23
+ - generate a first LTX 2.3 pass with the IC-Lora
24
+ - generate a second pass with a injection of the 3d render. It allows to have a more accurate version of the car models.
25
+
26
+
27
+ ## Model needed
28
+ ### Base model
29
+ - Klein 9b
30
+ - LTX 2.3
31
+ ### Lora
32
+ - [LTX-2.3-3DREAL-LoRA](https://huggingface.co/fal/LTX-2.3-3DREAL-LoRA)
33
+ - [Fusion Lora](https://civitai.com/models/2548669/image-blend-fusion-for-flux2-klein-4b-and-9b-edit)
34
+ ### Comfyui custom node
35
+ - KJN nodes
36
+ - LTX nodes
37
+ - Video Helper Suite
38
+ - RES4LYF (Sampler on second pass, not necessary)
39
+ - NKD sigma curves (Adjust Sigma on second pass, not necessary)
40
+
41
+
42
+ ```
43
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
44
+ β”‚Crypto Car Mask β”‚ β”‚Clayrender + 3D car β”‚ β”‚ Background β”‚ β”‚Foregroundβ”‚
45
+ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”˜
46
+ β”‚ β”‚ β”‚ β”‚ Klein 9B β”‚
47
+ β”‚ β”‚ β”‚ β”‚ β”‚
48
+ β”‚ β”‚ β”‚ └──── Blend + Fusion β”€β”€β”€β”˜
49
+ β”‚ β”‚ β”‚ LTX 2.3 β”‚
50
+ β”‚ β”‚ β”‚ β”‚
51
+ β”‚ β”‚ └───IC-LORA 3DREAL β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
52
+ β”‚ β”‚ β”‚
53
+ └──────── Mask Car only ──────────► β”‚
54
+ β”‚
55
+ β”‚
56
+ 2nd render pass
57
+ β”‚
58
+ β”‚
59
+
60
+ Final render
61
+ ```