Duplicate from Lightricks/LTX-2.3-nvfp4

Co-authored-by: Ofir Bibi <ofirbibi@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,35 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,126 @@
+---
+language:
+- en
+- de
+- es
+- fr
+- ja
+- ko
+- zh
+- it
+- pt
+library_name: diffusers
+license: other
+license_name: ltx-2-community-license-agreement
+license_link: https://github.com/Lightricks/LTX-2/blob/main/LICENSE
+pipeline_tag: image-to-video
+arxiv: 2601.03233
+tags:
+- image-to-video
+- text-to-video
+- video-to-video
+- image-text-to-video
+- audio-to-video
+- text-to-audio
+- video-to-audio
+- audio-to-audio
+- text-to-audio-video
+- image-to-audio-video
+- image-text-to-audio-video
+- ltx-2
+- ltx-2-3
+- ltx-video
+- ltxv
+- lightricks
+pinned: true
+demo: https://console.ltx.video/playground/
+---
+
+# LTX-2.3 NVFP4 Model Card
+
+**This is the NVFP4 versions of the LTX-2.3 model. All information below is derived from the base model.**
+
+This model card focuses on the LTX-2.3 model, which is a significant update to the [LTX-2 model](https://huggingface.co/Lightricks/LTX-2) with improved audio and visual quality as well as enhanced prompt adherence.
+LTX-2 was presented in the paper [LTX-2: Efficient Joint Audio-Visual Foundation Model](https://huggingface.co/papers/2601.03233).
+
+💻💻 **If you want to dive in right to the code - it is available [here](https://github.com/Lightricks/LTX-2).** 💾💾
+
+LTX-2.3 is a DiT-based audio-video foundation model designed to generate synchronized video and audio within a single model. It brings together the core building blocks of modern video generation, with open weights and a focus on practical, local execution. 
+
+[![LTX-2.3 Open Source](https://img.youtube.com/vi/o-7us-BR_gQ/maxresdefault.jpg)](https://youtu.be/o-7us-BR_gQ)
+
+# Model Checkpoints
+
+| Name                               | Notes                                                                                                              |
+|------------------------------------|--------------------------------------------------------------------------------------------------------------------|
+| ltx-2.3-22b-dev-nvfp4                    | The full model, flexible and trainable, in nvfp4, trained by Quantization Aware Distillation for improved accuracy    |
+| ltx-2.3-22b-distilled-nvfp4 (coming soon)              | The distilled version of the full model, 8 steps, CFG=1, in nvfp4                                                         |
+
+## Model Details
+- **Developed by:** Lightricks
+- **Model type:** Diffusion-based audio-video foundation model
+- **Language(s):** English
+
+# Online demo
+LTX-2.3 is accessible right away via the [API Playground](https://console.ltx.video/playground/).
+
+# Run locally
+
+## Direct use license
+You can use the models - full, distilled, upscalers and any derivatives of the models - for purposes under the [license](./LICENSE).
+
+## ComfyUI
+We recommend you use the built-in LTXVideo nodes that can be found in the ComfyUI Manager. 
+For manual installation information, please refer to our [documentation site](https://docs.ltx.video/open-source-model/integration-tools/comfy-ui).
+
+## PyTorch codebase
+
+The [LTX-2 codebase](https://github.com/Lightricks/LTX-2) is a monorepo with several packages. From model definition in 'ltx-core' to pipelines in 'ltx-pipelines' and training capabilities in 'ltx-trainer'.
+The codebase was tested with Python >=3.12, CUDA version >12.7, and supports PyTorch ~= 2.7.
+
+### Installation
+
+```bash
+git clone https://github.com/Lightricks/LTX-2.git
+cd LTX-2
+
+# From the repository root
+uv sync
+source .venv/bin/activate
+```
+
+### Inference
+
+To use our model, please follow the instructions in our [ltx-pipelines](https://github.com/Lightricks/LTX-2/blob/main/packages/ltx-pipelines/README.md) package.
+
+## Diffusers 🧨
+
+LTX-2.3 support in the [Diffusers Python library](https://huggingface.co/docs/diffusers/main/en/index) is coming soon!
+
+## General tips:
+* Width & height settings must be divisible by 32. Frame count must be divisible by 8 + 1. 
+* In case the resolution or number of frames are not divisible by 32 or 8 + 1, the input should be padded with -1 and then cropped to the desired resolution and number of frames.
+* For tips on writing effective prompts, please visit our [Prompting guide](https://ltx.video/blog/how-to-prompt-for-ltx-2) 
+
+### Limitations
+- This model is not intended or able to provide factual information.
+- As a statistical model this checkpoint might amplify existing societal biases.
+- The model may fail to generate videos that matches the prompts perfectly.
+- Prompt following is heavily influenced by the prompting-style.
+- The model may generate content that is inappropriate or offensive.
+- When generating audio without speech, the audio may be of lower quality.
+
+# Train the model
+
+Currently it is recommended to train the bf16 model. Recipes for training the fp8 model are welcome as community contributions.
+
+## Citation
+
+```bibtex
+@article{hacohen2025ltx2,
+  title={LTX-2: Efficient Joint Audio-Visual Foundation Model},
+  author={HaCohen, Yoav and Brazowski, Benny and Chiprut, Nisan and Bitterman, Yaki and Kvochko, Andrew and Berkowitz, Avishai and Shalem, Daniel and Lifschitz, Daphna and Moshe, Dudu and Porat, Eitan and Richardson, Eitan and Guy Shiran and Itay Chachy and Jonathan Chetboun and Michael Finkelson and Michael Kupchick and Nir Zabari and Nitzan Guetta and Noa Kotler and Ofir Bibi and Ori Gordon and Poriya Panet and Roi Benita and Shahar Armon and Victor Kulikov and Yaron Inger and Yonatan Shiftan and Zeev Melumian and Zeev Farbman},
+  journal={arXiv preprint arXiv:2601.03233},
+  year={2025}
+}
+```

ltx-2.3-22b-dev-nvfp4.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d0a66035d5eb9bd5d2b3bd5c1dd01cea1bdab4a0c6d3db6d62b12995741905f
+size 21701367310