Frederic75 vantagewithai commited on
Commit
7c16eba
·
0 Parent(s):

Duplicate from vantagewithai/LTX-2-GGUF

Browse files

Co-authored-by: Vantage with AI <vantagewithai@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ distilled/ltx-2-19b-distilled-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
37
+ distilled/ltx-2-19b-distilled-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ distilled/ltx-2-19b-distilled-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ distilled/ltx-2-19b-distilled-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ distilled/ltx-2-19b-distilled-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
41
+ distilled/ltx-2-19b-distilled-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ distilled/ltx-2-19b-distilled-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
43
+ distilled/ltx-2-19b-distilled-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
44
+ distilled/ltx-2-19b-distilled-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ distilled/ltx-2-19b-distilled-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ distilled/ltx-2-19b-distilled-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ distilled/ltx-2-19b-distilled-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
48
+ dev/ltx-2-19b-dev-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
49
+ dev/ltx-2-19b-dev-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ dev/ltx-2-19b-dev-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
51
+ dev/ltx-2-19b-dev-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
52
+ dev/ltx-2-19b-dev-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ dev/ltx-2-19b-dev-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
54
+ dev/ltx-2-19b-dev-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ dev/ltx-2-19b-dev-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ dev/ltx-2-19b-dev-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
57
+ dev/ltx-2-19b-dev-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
58
+ dev/ltx-2-19b-dev-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
59
+ dev/ltx-2-19b-dev-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,109 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: image-to-video
3
+ tags:
4
+ - image-to-video
5
+ - text-to-video
6
+ - video-to-video
7
+ - image-text-to-video
8
+ - audio-to-video
9
+ - text-to-audio
10
+ - video-to-audio
11
+ - audio-to-audio
12
+ - text-to-audio-video
13
+ - image-to-audio-video
14
+ - image-text-to-audio-video
15
+ - ltx-2
16
+ - ltx-video
17
+ - ltxv
18
+ - lightricks
19
+ pinned: true
20
+ language:
21
+ - en
22
+ - de
23
+ - es
24
+ - fr
25
+ - ja
26
+ - ko
27
+ - zh
28
+ - it
29
+ - pt
30
+ license: other
31
+ license_name: ltx-2-community-license-agreement
32
+ license_link: https://github.com/Lightricks/LTX-2/blob/main/LICENSE
33
+ library_name: diffusers
34
+ demo: https://app.ltx.studio/ltx-2-playground/i2v
35
+ ---
36
+
37
+ **Quantized GGUF version of Split LTX-2 checkpoint**
38
+
39
+ **Original model Link:** [https://huggingface.co/Lightricks/LTX-2](https://huggingface.co/Lightricks/LTX-2)
40
+
41
+ **Watch us at Youtube:** [@VantageWithAI](https://www.youtube.com/@vantagewithai)
42
+
43
+ # LTX-2 Model Card
44
+ This model card focuses on the LTX-2 model, codebase available [here](https://github.com/Lightricks/LTX-2).
45
+
46
+ LTX-2 is a DiT-based audio-video foundation model designed to generate synchronized video and audio within a single model. It brings together the core building blocks of modern video generation, with open weights and a focus on practical, local execution.
47
+
48
+ [![LTX-2 Open Source](https://img.youtube.com/vi/8fWAJXZJbRA/maxresdefault.jpg)](https://www.youtube.com/watch?v=8fWAJXZJbRA)
49
+
50
+ # Model Checkpoints
51
+
52
+ | Name | Notes |
53
+ |--------------------------------|----------------------------------------------------------------------------------------------------------------|
54
+ | ltx-2-19b-dev | The full model, flexible and trainable in bf16 |
55
+ | ltx-2-19b-dev-fp8 | The full model in fp8 quantization |
56
+ | ltx-2-19b-dev-fp4 | The full model in nvfp4 quantization |
57
+ | ltx-2-19b-distilled | The distilled version of the full model, 8 steps, CFG=1 |
58
+ | ltx-2-19b-distilled-lora-384 | A LoRA version of the distilled model applicable to the full model |
59
+ | ltx-2-spatial-upscaler-x2-1.0 | An x2 spatial upscaler for the ltx-2 latents, used in multi stage (multiscale) pipelines for higher resolution |
60
+ | ltx-2-temporal-upscaler-x2-1.0 | An x2 temporal upscaler for the ltx-2 latents, used in multi stage (multiscale) pipelines for higher FPS |
61
+
62
+ ## Model Details
63
+ - **Developed by:** Lightricks
64
+ - **Model type:** Diffusion-based audio-video foundation model
65
+ - **Language(s):** English
66
+
67
+ # Online demo
68
+ LTX-2 is accessible right away via the following links:
69
+ - [LTX-Studio text-to-video](https://app.ltx.studio/ltx-2-playground/t2v)
70
+ - [LTX-Studio image-to-video](https://app.ltx.studio/ltx-2-playground/i2v)
71
+
72
+ # Run locally
73
+
74
+ ## Direct use license
75
+ You can use the models - full, distilled, upscalers and any derivatives of the models - for purposes under the [license](./LICENSE).
76
+
77
+ ## ComfyUI
78
+ We recommend you use the built-in LTXVideo nodes that can be found in the ComfyUI Manager.
79
+ For manual installation information, please refer to our [documentation site](https://docs.ltx.video/open-source-model/integration-tools/comfy-ui).
80
+
81
+ ## PyTorch codebase
82
+
83
+ The [LTX-2 codebase](https://github.com/Lightricks/LTX-2) is a monorepo with several packages. From model definition in 'ltx-core' to pipelines in 'ltx-pipelines' and training capabilities in 'ltx-trainer'.
84
+ The codebase was tested with Python >=3.12, CUDA version >12.7, and supports PyTorch ~= 2.7.
85
+
86
+ ## Diffusers 🧨
87
+
88
+ LTX-2 is supported in the [Diffusers Python library](https://huggingface.co/docs/diffusers/main/en/index) for image-to-video generation.
89
+
90
+ ## General tips:
91
+ * Width & height settings must be divisible by 32. Frame count must be divisible by 8 + 1.
92
+ * In case the resolution or number of frames are not divisible by 32 or 8 + 1, the input should be padded with -1 and then cropped to the desired resolution and number of frames.
93
+ * For tips on writing effective prompts, please visit our [Prompting guide](https://ltx.video/blog/how-to-prompt-for-ltx-2)
94
+
95
+ ### Limitations
96
+ - This model is not intended or able to provide factual information.
97
+ - As a statistical model this checkpoint might amplify existing societal biases.
98
+ - The model may fail to generate videos that matches the prompts perfectly.
99
+ - Prompt following is heavily influenced by the prompting-style.
100
+ - The model may generate content that is inappropriate or offensive.
101
+ - When generating audio without speech, the audio may be of lower quality.
102
+
103
+ # Train the model
104
+
105
+ The base (dev) model is fully trainable.
106
+
107
+ It's extremely easy to reproduce the LoRAs and IC-LoRAs we publish with the model by following the instructions on the [LTX-2 Trainer Readme](https://github.com/Lightricks/LTX-2/blob/main/packages/ltx-trainer/README.md).
108
+
109
+ Training for motion, style or likeness (sound+appearance) can take less than an hour in many settings.
Vantage-LTX2-Advanced-Workflow-GGUF-Support.json ADDED
The diff for this file is too large to render. See raw diff
 
dev/ltx-2-19b-dev-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a48fc4463ec16d7424a195d4ea7603d8f099d51069ab0780863a94044cc8cc3
3
+ size 9961997184
dev/ltx-2-19b-dev-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0f4164873a90258dd79e0af18d0530574f57755bed91341219640a0c66d483b
3
+ size 9283502976
dev/ltx-2-19b-dev-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4de6c7cee24c98b893c144efdbfb88ffba950d90fd82c4bc847f8ab9ef9ae1e
3
+ size 11612128128
dev/ltx-2-19b-dev-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38258cae834231cc96e39479b976fc606108affe654e30da8bc2afe742b05679
3
+ size 12448891776
dev/ltx-2-19b-dev-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd1e54cb4be01ba3bfafd71b7ace6d58773c0501970c4cb250dd579ed9a799f0
3
+ size 12753044352
dev/ltx-2-19b-dev-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2ffc5b8f89734556d5dd71a57d03e891997163232ad5532ccd683353698ad22
3
+ size 11788288896
dev/ltx-2-19b-dev-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38eb061e0829a3be867154ef10ff1abacf36987754d18fc4c201134afa2e413d
3
+ size 13637976960
dev/ltx-2-19b-dev-Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1846cb09d9e306e1e2ef150d0e47137827b3b83f06ee8e6b04c4992b1d081889
3
+ size 14474740608
dev/ltx-2-19b-dev-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1da8d0acaa7dd1d5f840e58d42b55a428e4504a6f3fd93b55c5c13cfedb3991
3
+ size 14447805312
dev/ltx-2-19b-dev-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36339c8a112d427d2245a1b119138020fbcd4a952fcdc127525e2dcdec01078b
3
+ size 13461816192
dev/ltx-2-19b-dev-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15ce38acb11f6a51ba04340494b08af6ed81912bf5f588da74b37c0cd6edcabc
3
+ size 15921775488
dev/ltx-2-19b-dev-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ecf273fa0ed2a3d7fe43124e79b0c428cf9d4e5d66456bc28924ee4588cda36
3
+ size 20407583616
distilled/ltx-2-19b-distilled-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb121295a6700c3eb9136334508728c99597144b8a001257a7cdab0681f4b23a
3
+ size 9961997472
distilled/ltx-2-19b-distilled-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a5e70f592a21d3cab94f8a607151f6b1dc304b272f90c79626d524965c4c26c
3
+ size 9283503264
distilled/ltx-2-19b-distilled-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f493c615582d6c33674300c9b5d3ac7ae5de1e89e43fb005bead36a2b299d71a
3
+ size 11612128416
distilled/ltx-2-19b-distilled-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:978467836de8b8224ef1449211be4d78c1d017b38f902fb2fba1a94f1ae9b891
3
+ size 12448892064
distilled/ltx-2-19b-distilled-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc18d3d835230c8f7d9b5f4c90423d1826c0f855642f60faf8fc6a3bc58449f0
3
+ size 12753044640
distilled/ltx-2-19b-distilled-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:319c413c2d98482c27600ccd379a1ec5e66f0b24a7b0780b1de750ae3165e480
3
+ size 11788289184
distilled/ltx-2-19b-distilled-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed631310e1b9022b01d97ec7e5b93e2009842ad2112529e5eb6228868d45ba46
3
+ size 13637977248
distilled/ltx-2-19b-distilled-Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e7396cf18e1802e8464164f8661b4b34314f0161488cbf68cbaba463f1ab6b9
3
+ size 14474740896
distilled/ltx-2-19b-distilled-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e2b53ea57cfb5acc2129fa31bf0889485ca24a611d735c8226ff73e5d53ac5c
3
+ size 14447805600
distilled/ltx-2-19b-distilled-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a41f15575b2ba108a9abb5b0400d667763907e2a6d1cdfc13e16ecc7f8a594cf
3
+ size 13461816480
distilled/ltx-2-19b-distilled-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1908b61b0c618fc07fde65143f3fb9913b0de0473af8587836a6ad87b6098d7e
3
+ size 15921775776
distilled/ltx-2-19b-distilled-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:199d4f098b52e75f8a34a3d531d8b4b4cf7e23ea6a40b30fe8df7eadf51a8aa8
3
+ size 20407583904