Instructions to use xocialize/ltx-2.3-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use xocialize/ltx-2.3-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir ltx-2.3-mlx xocialize/ltx-2.3-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Upload folder using huggingface_hub
Browse files- LICENSE +382 -0
- README.md +85 -0
- config.json +42 -0
- embedded_config.json +356 -0
- spatial_upscaler_x1_5_v1_0_config.json +13 -0
- spatial_upscaler_x2_v1_1_config.json +13 -0
- split_model.json +33 -0
- temporal_upscaler_x2_v1_0_config.json +13 -0
LICENSE
ADDED
|
@@ -0,0 +1,382 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
LTX-2 Community License Agreement
|
| 2 |
+
License date: January 5, 2026
|
| 3 |
+
|
| 4 |
+
|
| 5 |
+
By using or distributing any portion or element of LTX-2, you agree
|
| 6 |
+
to be bound by this Agreement.
|
| 7 |
+
|
| 8 |
+
1. Definitions.
|
| 9 |
+
|
| 10 |
+
"Agreement" means the terms and conditions for the license, use,
|
| 11 |
+
reproduction, and distribution of LTX-2 and the Complementary
|
| 12 |
+
Materials, as specified in this document.
|
| 13 |
+
|
| 14 |
+
"Control" means the direct or indirect ownership of fifty percent
|
| 15 |
+
(50%) or more of the voting securities or other ownership
|
| 16 |
+
interests, or the power to direct the management and policies of
|
| 17 |
+
such Entity through voting rights, contract, or otherwise.
|
| 18 |
+
|
| 19 |
+
"Data" means a collection of information and/or content extracted
|
| 20 |
+
from the dataset used with LTX-2, including to train, pretrain,
|
| 21 |
+
or otherwise evaluate LTX-2. The Data is not licensed under this
|
| 22 |
+
Agreement.
|
| 23 |
+
|
| 24 |
+
"Derivatives of LTX-2" means all modifications to LTX-2, works
|
| 25 |
+
based on LTX-2, or any other model which is created or initialized
|
| 26 |
+
by transfer of patterns of the weights, parameters, activations or
|
| 27 |
+
output of LTX-2, to the other model, in order to cause the other
|
| 28 |
+
model to perform similarly to LTX-2, including – but not limited
|
| 29 |
+
to - distillation methods entailing the use of intermediate data
|
| 30 |
+
representations or methods based on the generation of synthetic
|
| 31 |
+
data by LTX-2 for training the other model. For clarity, Derivatives
|
| 32 |
+
of LTX-2 include: (i) any fine-tuned or adapted weights, parameters,
|
| 33 |
+
or checkpoints derived from LTX-2; (ii) derivative model architectures
|
| 34 |
+
that incorporate or are based upon LTX-2's architecture; and
|
| 35 |
+
(iii) any modified or extended versions of the Complementary
|
| 36 |
+
Materials. All intellectual property rights in Derivatives of LTX-2
|
| 37 |
+
shall be subject to the terms of this Agreement, and you may not
|
| 38 |
+
claim exclusive ownership rights in any Derivatives of LTX-2 that
|
| 39 |
+
would restrict the rights granted herein.
|
| 40 |
+
|
| 41 |
+
"Entity" means any individual, corporation, partnership, limited
|
| 42 |
+
liability company, or other legal entity. For purposes of this
|
| 43 |
+
Agreement, an Entity shall be deemed to include, on an aggregative
|
| 44 |
+
basis, all subsidiaries, affiliates, and other companies under
|
| 45 |
+
common Control with such Entity. When determining whether an Entity
|
| 46 |
+
meets any threshold under this Agreement (including revenue
|
| 47 |
+
thresholds), all subsidiaries, affiliates, and companies under
|
| 48 |
+
common Control shall be considered collectively.
|
| 49 |
+
|
| 50 |
+
"Harm" includes but is not limited to physical, mental,
|
| 51 |
+
psychological, financial and reputational damage, pain, or loss.
|
| 52 |
+
|
| 53 |
+
"Licensor" or "Lightricks" means the owner that is granting the
|
| 54 |
+
license under this Agreement. For the purposes of this Agreement,
|
| 55 |
+
the Licensor is Lightricks Ltd.
|
| 56 |
+
|
| 57 |
+
"LTX-2" means the large language models, text/image/video/audio/3D
|
| 58 |
+
generation models, and multimodal large language models and their
|
| 59 |
+
software and algorithms, including trained model weights, parameters
|
| 60 |
+
(including optimizer states), machine-learning model code,
|
| 61 |
+
inference-enabling code, training-enabling code, fine-tuning
|
| 62 |
+
enabling code, accompanying source code, scripts, documentation,
|
| 63 |
+
tutorials, examples, and all other elements of the foregoing
|
| 64 |
+
distributed and made publicly available by Lightricks (including,
|
| 65 |
+
for example, at https://github.com/Lightricks/LTX-2) for the LTX-2
|
| 66 |
+
model released on January 5, 2026. This license is applicable to
|
| 67 |
+
all LTX-2 versions released since January 5, 2026, and all future
|
| 68 |
+
releases of LTX-2 under this license.
|
| 69 |
+
|
| 70 |
+
"Output" means the results of operating LTX-2 as embodied in
|
| 71 |
+
informational content resulting therefrom.
|
| 72 |
+
|
| 73 |
+
"you" (or "your") means an individual or legal Entity licensing
|
| 74 |
+
LTX-2 in accordance with this Agreement and/or making use of LTX-2
|
| 75 |
+
for whichever purpose and in any field of use, including usage of
|
| 76 |
+
LTX-2 in an end-use application - e.g. chatbot, translator, image
|
| 77 |
+
generator.
|
| 78 |
+
|
| 79 |
+
2. Grant of License. Subject to the terms and conditions of this
|
| 80 |
+
Agreement, you are granted a non-exclusive, worldwide,
|
| 81 |
+
non-transferable and royalty-free limited license under Licensor's
|
| 82 |
+
intellectual property or other rights owned by Licensor embodied
|
| 83 |
+
in LTX-2 to use, reproduce, prepare, distribute, publicly display,
|
| 84 |
+
publicly perform, sublicense, copy, create derivative works of,
|
| 85 |
+
and make modifications to LTX-2, for any purpose, subject to the
|
| 86 |
+
restrictions set forth in Attachment A; provided however, that
|
| 87 |
+
Entities with annual revenues of at least $10,000,000 (the
|
| 88 |
+
"Commercial Entities") are required to obtain a paid commercial
|
| 89 |
+
use license in order to use LTX-2 and Derivatives of LTX-2,
|
| 90 |
+
subject to the terms and provisions of a different license (the
|
| 91 |
+
"Commercial Use Agreement"), as will be provided by the Licensor.
|
| 92 |
+
Commercial Entities interested in such a commercial license are
|
| 93 |
+
required to [contact Licensor](https://ltx.io/model/licensing).
|
| 94 |
+
Any commercial use of LTX-2 or Derivatives of LTX-2 by the Commercial
|
| 95 |
+
Entities not in accordance with this Agreement and/or the Commercial
|
| 96 |
+
Use Agreement is strictly prohibited and shall be deemed a material
|
| 97 |
+
breach of this Agreement.
|
| 98 |
+
Such material breach will be subject, in addition to any license
|
| 99 |
+
fees owed to Licensor for the period such Commercial Entity used
|
| 100 |
+
LTX-2 (as will be determined by Licensor), to liquidated damages,
|
| 101 |
+
which will be paid to Licensor immediately upon demand, in an
|
| 102 |
+
amount equal to double the amount that would otherwise have been
|
| 103 |
+
paid by you for the relevant period of time. Such amount reflects
|
| 104 |
+
a reasonable estimation of the losses and administrative costs
|
| 105 |
+
incurred due to such breach. You agree and understand that this
|
| 106 |
+
remedy does not limit the Licensor's right to pursue other remedies
|
| 107 |
+
available at law or equity.
|
| 108 |
+
|
| 109 |
+
3. Distribution and Redistribution. You may host for third parties
|
| 110 |
+
remote access purposes (e.g. software-as-a-service), reproduce
|
| 111 |
+
and distribute copies of LTX-2 or Derivatives of LTX-2 thereof in
|
| 112 |
+
any medium, with or without modifications, provided that you meet
|
| 113 |
+
the following conditions:
|
| 114 |
+
|
| 115 |
+
(a) Use-based restrictions as referenced in paragraph 4 and all
|
| 116 |
+
provisions of Attachment A MUST be included as an enforceable
|
| 117 |
+
provision by you in any type of legal agreement (e.g. a
|
| 118 |
+
license) governing the use and/or distribution of LTX-2 or
|
| 119 |
+
Derivatives of LTX-2, and you shall give notice to subsequent
|
| 120 |
+
users you distribute to, that LTX-2 or Derivatives of LTX-2
|
| 121 |
+
are subject to paragraph 4 and Attachment A in their entirety,
|
| 122 |
+
including all use restrictions and acceptable use policies;
|
| 123 |
+
|
| 124 |
+
(b) You must provide any third party recipients of LTX-2 or
|
| 125 |
+
Derivatives of LTX-2 a copy of this Agreement, including all
|
| 126 |
+
attachments and use policies. Any Derivative of LTX-2 (as
|
| 127 |
+
defined in Section 1, including but not limited to fine-tuned
|
| 128 |
+
weights, modified training code, models trained on Outputs, or
|
| 129 |
+
any other derivative) must be distributed exclusively under
|
| 130 |
+
the terms of this Agreement with a complete copy of this
|
| 131 |
+
license included;
|
| 132 |
+
|
| 133 |
+
(c) You must cause any modified files to carry prominent notices
|
| 134 |
+
stating that you changed the files;
|
| 135 |
+
|
| 136 |
+
(d) You must retain all copyright, patent, trademark, and
|
| 137 |
+
attribution notices excluding those notices that do not
|
| 138 |
+
pertain to any part of LTX-2, Derivatives of LTX-2.
|
| 139 |
+
|
| 140 |
+
You may add your own copyright statement to your modifications and
|
| 141 |
+
may provide additional or different license terms and conditions -
|
| 142 |
+
respecting paragraph 3(a) - for use, reproduction, or distribution
|
| 143 |
+
of your modifications, or for any such Derivatives of LTX-2 as a
|
| 144 |
+
whole, provided your use, reproduction, and distribution of LTX-2
|
| 145 |
+
otherwise complies with the conditions stated in this Agreement,
|
| 146 |
+
and you provide a complete copy of this Agreement with any such
|
| 147 |
+
use, reproduction and distribution of LTX-2 and any Derivatives
|
| 148 |
+
thereof.
|
| 149 |
+
|
| 150 |
+
4. Use-based restrictions. The restrictions set forth in Attachment A
|
| 151 |
+
are considered Use-based restrictions. Therefore, you cannot use
|
| 152 |
+
LTX-2 and the Derivatives of LTX-2 in violation of the specified
|
| 153 |
+
restricted uses. You may use LTX-2 subject to this Agreement,
|
| 154 |
+
including only for lawful purposes and in accordance with the
|
| 155 |
+
Agreement. "Use" may include creating any content with, fine-tuning,
|
| 156 |
+
updating, running, training, evaluating and/or re-parametrizing
|
| 157 |
+
LTX-2. You shall require all of your users who use LTX-2 or a
|
| 158 |
+
Derivative of LTX-2 to comply with the terms of this paragraph 4.
|
| 159 |
+
|
| 160 |
+
5. The Output You Generate. Except as set forth herein, Licensor
|
| 161 |
+
claims no rights in the Output you generate using LTX-2. You are
|
| 162 |
+
accountable for input you insert into LTX-2, the Output you
|
| 163 |
+
generate and its subsequent uses. No use of the Output can
|
| 164 |
+
contravene any provision as stated in the Agreement.
|
| 165 |
+
|
| 166 |
+
6. Updates and Runtime Restrictions. To the maximum extent permitted
|
| 167 |
+
by law, Licensor reserves the right to restrict (remotely or
|
| 168 |
+
otherwise) usage of LTX-2 in violation of this Agreement, update
|
| 169 |
+
LTX-2 through electronic means, or modify the Output of LTX-2
|
| 170 |
+
based on updates. You shall undertake reasonable efforts to use
|
| 171 |
+
the latest version of LTX-2. Any use of the non-current version
|
| 172 |
+
of LTX-2 is done solely at your risk.
|
| 173 |
+
|
| 174 |
+
7. Export Controls and Sanctions Compliance. You acknowledge that
|
| 175 |
+
LTX-2, Derivatives of LTX-2 may be subject to export control laws
|
| 176 |
+
and regulations, including but not limited to the U.S. Export
|
| 177 |
+
Administration Regulations and sanctions programs administered by
|
| 178 |
+
the Office of Foreign Assets Control (OFAC). You represent and
|
| 179 |
+
warrant that you and any users of LTX-2 are not (i) located in,
|
| 180 |
+
organized under the laws of, or ordinarily resident in any country
|
| 181 |
+
or territory subject to comprehensive sanctions; (ii) identified
|
| 182 |
+
on any U.S. government restricted party list, including the
|
| 183 |
+
Specially Designated Nationals and Blocked Persons List; or
|
| 184 |
+
(iii) otherwise prohibited from receiving LTX-2 under applicable
|
| 185 |
+
law. You shall not export, re-export, or transfer LTX-2, directly
|
| 186 |
+
or indirectly, in violation of any applicable export control or
|
| 187 |
+
sanctions laws or regulations. You agree to comply with all
|
| 188 |
+
applicable trade control laws and shall indemnify and hold
|
| 189 |
+
Licensor harmless from any claims arising from your failure to
|
| 190 |
+
comply with such laws.
|
| 191 |
+
|
| 192 |
+
8. Trademarks and related. Nothing in this Agreement permits you to
|
| 193 |
+
make use of Licensor's trademarks, trade names, logos or to
|
| 194 |
+
otherwise suggest endorsement or misrepresent the relationship
|
| 195 |
+
between the parties; and any rights not expressly granted herein
|
| 196 |
+
are reserved by the Licensor.
|
| 197 |
+
|
| 198 |
+
9. Disclaimer of Warranty. Unless required by applicable law or
|
| 199 |
+
agreed to in writing, Licensor provides LTX-2 on an "AS IS" BASIS,
|
| 200 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 201 |
+
implied, including, without limitation, any warranties or
|
| 202 |
+
conditions of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS
|
| 203 |
+
FOR A PARTICULAR PURPOSE. You are solely responsible for
|
| 204 |
+
determining the appropriateness of using or redistributing LTX-2
|
| 205 |
+
and Derivatives of LTX-2 and assume any risks associated with
|
| 206 |
+
your exercise of permissions under this Agreement.
|
| 207 |
+
|
| 208 |
+
10. Limitation of Liability. In no event and under no legal theory,
|
| 209 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 210 |
+
unless required by applicable law (such as deliberate and grossly
|
| 211 |
+
negligent acts) or agreed to in writing, shall Licensor be liable
|
| 212 |
+
to you for damages, including any direct, indirect, special,
|
| 213 |
+
incidental, or consequential damages of any character arising as
|
| 214 |
+
a result of this Agreement or out of the use or inability to use
|
| 215 |
+
LTX-2 (including but not limited to damages for loss of goodwill,
|
| 216 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 217 |
+
other commercial damages or losses), even if Licensor has been
|
| 218 |
+
advised of the possibility of such damages.
|
| 219 |
+
|
| 220 |
+
11. Accepting Warranty or Additional Liability. While redistributing
|
| 221 |
+
LTX-2 and Derivatives of LTX-2, you may, provided you do not
|
| 222 |
+
violate the terms of this Agreement, choose to offer and charge
|
| 223 |
+
a fee for, acceptance of support, warranty, indemnity, or other
|
| 224 |
+
liability obligations. However, in accepting such obligations,
|
| 225 |
+
you may act only on your own behalf and on your sole
|
| 226 |
+
responsibility, not on behalf of Licensor, and only if you agree
|
| 227 |
+
to indemnify, defend, and hold Licensor harmless for any liability
|
| 228 |
+
incurred by, or claims asserted against Licensor, by reason of
|
| 229 |
+
your accepting any such warranty or additional liability.
|
| 230 |
+
|
| 231 |
+
12. Governing Law. This Agreement and all relations, disputes, claims
|
| 232 |
+
and other matters arising hereunder (including non-contractual
|
| 233 |
+
disputes or claims) will be governed exclusively by, and construed
|
| 234 |
+
exclusively in accordance with, the laws of the State of New York.
|
| 235 |
+
To the extent permitted by law, choice of laws rules and the
|
| 236 |
+
United Nations Convention on Contracts for the International Sale
|
| 237 |
+
of Goods will not apply. For the purposes of adjudicating any
|
| 238 |
+
action or proceeding to enforce the terms of this Agreement, you
|
| 239 |
+
hereby irrevocably consent to the exclusive jurisdiction of, and
|
| 240 |
+
venue in, the federal and state courts located in the County of
|
| 241 |
+
New York within the State of New York. The prevailing party in
|
| 242 |
+
any claim or dispute between the parties under this Agreement
|
| 243 |
+
will be entitled to reimbursement of its reasonable attorneys'
|
| 244 |
+
fees and costs. You hereby waive the right to a trial by jury,
|
| 245 |
+
to participate in a class or representative action (including in
|
| 246 |
+
arbitration), or to combine individual proceedings in court or
|
| 247 |
+
in arbitration without the consent of all parties.
|
| 248 |
+
|
| 249 |
+
13. Term and Termination. This Agreement is effective upon your
|
| 250 |
+
acceptance and continues until terminated. Licensor may terminate
|
| 251 |
+
this Agreement immediately upon written notice to you if you
|
| 252 |
+
breach any provision of this Agreement, including but not limited
|
| 253 |
+
to violations of the use restrictions in Attachment A or
|
| 254 |
+
unauthorized commercial use. Upon termination: (a) all rights
|
| 255 |
+
granted to you under this Agreement will immediately cease;
|
| 256 |
+
(b) you must immediately cease all use of LTX-2 and Derivatives
|
| 257 |
+
of LTX-2; (c) you must delete or destroy all copies of LTX-2
|
| 258 |
+
and Derivatives of LTX-2 in your possession or control; and
|
| 259 |
+
(d) you must notify any third parties to whom you distributed
|
| 260 |
+
LTX-2 or Derivatives of LTX-2 of the termination. Sections 8-13,
|
| 261 |
+
and Section 15 shall survive termination of this Agreement.
|
| 262 |
+
Termination does not relieve you of any obligations incurred
|
| 263 |
+
prior to termination, including payment obligations under
|
| 264 |
+
Section 2. In addition, if You commence a lawsuit or other
|
| 265 |
+
proceedings (including a cross-claim or counterclaim in a lawsuit)
|
| 266 |
+
against Licensor or any person or entity alleging that LTX-2 or
|
| 267 |
+
any Output, or any portion of any of the foregoing, infringe any
|
| 268 |
+
intellectual property or other right owned or licensable by you,
|
| 269 |
+
then all licenses granted to you under this Agreement shall
|
| 270 |
+
terminate as of the date such lawsuit or other proceeding is filed.
|
| 271 |
+
|
| 272 |
+
14. Disputes and Arbitration. All disputes arising in connection with
|
| 273 |
+
this Agreement shall be finally settled by arbitration under the
|
| 274 |
+
Rules of Arbitration of the International Chamber of Commerce
|
| 275 |
+
("ICC Rules"), by one (1) arbitrator appointed in accordance with
|
| 276 |
+
the ICC Rules. The seat of arbitration shall be New York, NY, USA,
|
| 277 |
+
and the proceedings shall be conducted in English. The arbitrator
|
| 278 |
+
shall be empowered to grant any relief that a court could grant.
|
| 279 |
+
Judgment on the arbitration award may be entered by any court
|
| 280 |
+
having jurisdiction thereof. Each party waives its right to a
|
| 281 |
+
trial by jury and to participate in any class or representative
|
| 282 |
+
action.
|
| 283 |
+
|
| 284 |
+
15. If any provision of this Agreement is held to be
|
| 285 |
+
invalid, illegal
|
| 286 |
+
or unenforceable, the remaining provisions shall be unaffected
|
| 287 |
+
thereby and remain valid as if such provision had not been set
|
| 288 |
+
forth herein.
|
| 289 |
+
|
| 290 |
+
END OF TERMS AND CONDITIONS
|
| 291 |
+
|
| 292 |
+
ATTACHMENT A: Use Restrictions
|
| 293 |
+
|
| 294 |
+
When using the Outputs, LTX-2 and any Derivatives thereof, you
|
| 295 |
+
will comply with the Acceptable Use Policy. In addition, you
|
| 296 |
+
agree not to use the Outputs, LTX-2 or its Derivatives in any
|
| 297 |
+
of the following ways:
|
| 298 |
+
|
| 299 |
+
1. In any way that violates any applicable national, federal,
|
| 300 |
+
state, local or international law or regulation;
|
| 301 |
+
|
| 302 |
+
2. For the purpose of exploiting, Harming or attempting to
|
| 303 |
+
exploit or Harm minors in any way;
|
| 304 |
+
|
| 305 |
+
3. To generate or disseminate false information and/or content
|
| 306 |
+
with the purpose of Harming others;
|
| 307 |
+
|
| 308 |
+
4. To generate or disseminate personal identifiable information
|
| 309 |
+
that can be used to Harm an individual;
|
| 310 |
+
|
| 311 |
+
5. To generate or disseminate information and/or content (e.g.
|
| 312 |
+
images, code, posts, articles), and place the information
|
| 313 |
+
and/or content in any context (e.g. bot generating tweets)
|
| 314 |
+
without expressly and intelligibly disclaiming that the
|
| 315 |
+
information and/or content is machine generated;
|
| 316 |
+
|
| 317 |
+
6. To defame, disparage or otherwise harass others;
|
| 318 |
+
|
| 319 |
+
7. To impersonate or attempt to impersonate (e.g. deepfakes)
|
| 320 |
+
others without their consent;
|
| 321 |
+
|
| 322 |
+
8. For fully automated decision making that adversely impacts an
|
| 323 |
+
individual's legal rights or otherwise creates or modifies a
|
| 324 |
+
binding, enforceable obligation;
|
| 325 |
+
|
| 326 |
+
9. For any use intended to or which has the effect of
|
| 327 |
+
discriminating against or Harming individuals or groups based
|
| 328 |
+
on online or offline social behavior or known or predicted
|
| 329 |
+
personal or personality characteristics;
|
| 330 |
+
|
| 331 |
+
10. To exploit any of the vulnerabilities of a specific group of
|
| 332 |
+
persons based on their age, social, physical or mental
|
| 333 |
+
characteristics, in order to materially distort the behavior
|
| 334 |
+
of a person pertaining to that group in a manner that causes
|
| 335 |
+
or is likely to cause that person or another person physical
|
| 336 |
+
or psychological Harm;
|
| 337 |
+
|
| 338 |
+
11. For any use intended to or which has the effect of
|
| 339 |
+
discriminating against individuals or groups based on legally
|
| 340 |
+
protected characteristics or categories;
|
| 341 |
+
|
| 342 |
+
12. To provide medical advice and medical results interpretation;
|
| 343 |
+
|
| 344 |
+
13. To generate or disseminate information for the purpose to be
|
| 345 |
+
used for administration of justice, law enforcement,
|
| 346 |
+
immigration or asylum processes, such as predicting an
|
| 347 |
+
individual will commit fraud/crime commitment (e.g. by text
|
| 348 |
+
profiling, drawing causal relationships between assertions
|
| 349 |
+
made in documents, indiscriminate and arbitrarily-targeted use);
|
| 350 |
+
|
| 351 |
+
14. To generate and/or disseminate malware (including – but not
|
| 352 |
+
limited to – ransomware) or any other content to be used for
|
| 353 |
+
the purpose of harming electronic systems;
|
| 354 |
+
|
| 355 |
+
15. To engage in, promote, incite, or facilitate discrimination
|
| 356 |
+
or other unlawful or harmful conduct in the provision of
|
| 357 |
+
employment, employment benefits, credit, housing, or other
|
| 358 |
+
essential goods and services;
|
| 359 |
+
|
| 360 |
+
16. To engage in, promote, incite, or facilitate the harassment,
|
| 361 |
+
abuse, threatening, or bullying of individuals or groups of
|
| 362 |
+
individuals;
|
| 363 |
+
|
| 364 |
+
17. For military, warfare, nuclear industries or applications,
|
| 365 |
+
weapons development, or any use in connection with activities
|
| 366 |
+
that may cause death, personal injury, or severe physical or
|
| 367 |
+
environmental damage;
|
| 368 |
+
|
| 369 |
+
18. For commercial use only: To train, improve, or fine-tune any
|
| 370 |
+
other machine learning model, artificial intelligence system,
|
| 371 |
+
or competing model, except for Derivatives of LTX-2 as
|
| 372 |
+
expressly permitted under this Agreement;
|
| 373 |
+
|
| 374 |
+
19. To circumvent, disable, or interfere with any technical
|
| 375 |
+
limitations, safety features, content filters, or use
|
| 376 |
+
restrictions implemented in LTX-2 by Licensor;
|
| 377 |
+
|
| 378 |
+
20. To use LTX-2 or Derivatives of LTX-2 in any product, service,
|
| 379 |
+
or application that directly competes with Licensor's
|
| 380 |
+
commercial products or services, or is designed to replace or
|
| 381 |
+
substitute Licensor's offerings in the market, without
|
| 382 |
+
obtaining a separate commercial license from Licensor.
|
README.md
ADDED
|
@@ -0,0 +1,85 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: ltx-2-community-license
|
| 4 |
+
license_link: LICENSE
|
| 5 |
+
base_model: Lightricks/LTX-2
|
| 6 |
+
tags:
|
| 7 |
+
- mlx
|
| 8 |
+
- apple-silicon
|
| 9 |
+
- text-to-video
|
| 10 |
+
- image-to-video
|
| 11 |
+
library_name: mlx
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# ltx-2.3-mlx — bf16 components + distilled transformer
|
| 15 |
+
|
| 16 |
+
**A verbatim availability mirror.** Full-precision LTX-2.3 components (connector, video/audio VAEs, vocoder, spatial upscaler) plus the bf16 distilled transformer.
|
| 17 |
+
|
| 18 |
+
## Why this repo exists
|
| 19 |
+
|
| 20 |
+
This is an unmodified mirror of [`dgrauet/ltx-2.3-mlx`](https://huggingface.co/dgrauet/ltx-2.3-mlx),
|
| 21 |
+
hosted so that downstream software has a weight source that does not depend on a third-party
|
| 22 |
+
namespace remaining available. It exists for **durability, not improvement** — there is nothing
|
| 23 |
+
here you cannot get upstream, and upstream is the better place to get it if you want the
|
| 24 |
+
newest revision.
|
| 25 |
+
|
| 26 |
+
The motivation is concrete rather than hypothetical: an unrelated model family we ship ports
|
| 27 |
+
of was relocated to a new organization without HTTP redirects, and every published package
|
| 28 |
+
referencing the old paths broke the same day. Availability is a dependency like any other.
|
| 29 |
+
|
| 30 |
+
## Provenance chain
|
| 31 |
+
|
| 32 |
+
| Stage | Who | What |
|
| 33 |
+
|---|---|---|
|
| 34 |
+
| Original weights | **Lightricks** | [LTX-2](https://huggingface.co/Lightricks/LTX-2) — a DiT-based joint audio+video model. All model IP is theirs. |
|
| 35 |
+
| MLX conversion | **dgrauet** | Converted to MLX format with [mlx-forge](https://github.com/dgrauet/mlx-forge); published as [`dgrauet/ltx-2.3-mlx`](https://huggingface.co/dgrauet/ltx-2.3-mlx) alongside the [ltx-2-mlx](https://github.com/dgrauet/ltx-2-mlx) inference pipeline. |
|
| 36 |
+
| This mirror | xocialize | **Byte-for-byte copy. No modification of any kind.** |
|
| 37 |
+
|
| 38 |
+
**We did not convert, quantize, fine-tune, or otherwise alter these weights.** Every tensor
|
| 39 |
+
file here was verified by SHA-256 against the corresponding upstream file at mirror time; the
|
| 40 |
+
hashes are listed below so anyone can check that claim independently.
|
| 41 |
+
|
| 42 |
+
Small JSON metadata files were taken fresh from upstream at mirror time and may therefore carry
|
| 43 |
+
metadata additions relative to an older local copy; the tensor files are the verified artifacts.
|
| 44 |
+
|
| 45 |
+
## Licence — read this before use
|
| 46 |
+
|
| 47 |
+
These weights are governed by the **LTX-2 Community License Agreement** (dated January 5, 2026),
|
| 48 |
+
included in full as [`LICENSE`](LICENSE) in this repository. Mirroring does not alter, relax, or
|
| 49 |
+
re-license anything.
|
| 50 |
+
|
| 51 |
+
Two obligations deserve to be called out explicitly, because they are easy to miss and they bind
|
| 52 |
+
*you* as a user of these weights, not just us as a distributor:
|
| 53 |
+
|
| 54 |
+
1. **Use-based restrictions (paragraph 4 and Attachment A) apply in their entirety.** Attachment A
|
| 55 |
+
is an enforceable part of the licence and lists prohibited uses. You must comply with it, and
|
| 56 |
+
you must require the same of anyone you distribute to.
|
| 57 |
+
2. **Attachment A item 20 is a non-compete.** Using LTX-2 or its derivatives in a product or
|
| 58 |
+
service that competes with, replaces, or substitutes Lightricks' commercial offerings requires
|
| 59 |
+
a separate commercial licence from Lightricks. There is also a revenue threshold in the
|
| 60 |
+
agreement's commercial terms. If you are building a product, read the licence yourself rather
|
| 61 |
+
than relying on this summary.
|
| 62 |
+
|
| 63 |
+
Any redistribution of these weights or derivatives of them must carry a complete copy of the
|
| 64 |
+
agreement and propagate these terms (§3). This summary is a courtesy pointer, **not** a substitute
|
| 65 |
+
for the licence text, and where the two differ the licence governs.
|
| 66 |
+
|
| 67 |
+
## Verified file hashes (SHA-256)
|
| 68 |
+
|
| 69 |
+
Each matches the corresponding file at `dgrauet/ltx-2.3-mlx` as of 2026-08-03:
|
| 70 |
+
|
| 71 |
+
```
|
| 72 |
+
442119db8eaf976f83a105cc8c5f2c930e0f625062f9776b10adcdb7bc96c416 audio_vae.safetensors
|
| 73 |
+
5885c2bd7af4e761b3257cf5b17bc1fdb2d187cea3ca520ea723b6a129b7029f connector.safetensors
|
| 74 |
+
755f69dcb8a3f9589045925eb4a2237e9969f9c026a016393bc395e65ebd5788 spatial_upscaler_x2_v1_1.safetensors
|
| 75 |
+
bd5c649bb658107ac73d39a9123a313c55630d3e2b7b78a5bd7d52ea782cac0e transformer-distilled.safetensors
|
| 76 |
+
f404026fe0b59418eaec4a3fcdc474125c798f0b787dc390f6eb4e79934d4160 vae_decoder.safetensors
|
| 77 |
+
1512f5ef8387901db0baecb328690676e2667ddf2b63e28f8e6645188c1a8c06 vae_encoder.safetensors
|
| 78 |
+
410cee86c14f76956bf487d153211ef15050fe8bf51f86d47a1d27ca6e3ba287 vocoder.safetensors
|
| 79 |
+
```
|
| 80 |
+
|
| 81 |
+
## Credit
|
| 82 |
+
|
| 83 |
+
All model design, training, and weights are the work of **Lightricks**. The MLX conversion and
|
| 84 |
+
the accompanying inference pipeline are the work of **dgrauet**. This mirror contributes nothing
|
| 85 |
+
but disk space and an address that we can promise not to move.
|
config.json
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model_version": "2.3.0",
|
| 3 |
+
"is_v2": true,
|
| 4 |
+
"model_type": "AudioVideo",
|
| 5 |
+
"num_attention_heads": 32,
|
| 6 |
+
"attention_head_dim": 128,
|
| 7 |
+
"in_channels": 128,
|
| 8 |
+
"out_channels": 128,
|
| 9 |
+
"num_layers": 48,
|
| 10 |
+
"cross_attention_dim": 4096,
|
| 11 |
+
"caption_channels": null,
|
| 12 |
+
"apply_gated_attention": true,
|
| 13 |
+
"audio_num_attention_heads": 32,
|
| 14 |
+
"audio_attention_head_dim": 64,
|
| 15 |
+
"audio_in_channels": 128,
|
| 16 |
+
"audio_out_channels": 128,
|
| 17 |
+
"audio_cross_attention_dim": 2048,
|
| 18 |
+
"positional_embedding_theta": 10000.0,
|
| 19 |
+
"positional_embedding_max_pos": [
|
| 20 |
+
20,
|
| 21 |
+
2048,
|
| 22 |
+
2048
|
| 23 |
+
],
|
| 24 |
+
"audio_positional_embedding_max_pos": [
|
| 25 |
+
20
|
| 26 |
+
],
|
| 27 |
+
"timestep_scale_multiplier": 1000,
|
| 28 |
+
"av_ca_timestep_scale_multiplier": 1000,
|
| 29 |
+
"norm_eps": 1e-06,
|
| 30 |
+
"connector_positional_embedding_max_pos": [
|
| 31 |
+
4096
|
| 32 |
+
],
|
| 33 |
+
"connector_rope_type": "SPLIT",
|
| 34 |
+
"variants": {
|
| 35 |
+
"distilled": {
|
| 36 |
+
"cross_attention_adaln": true
|
| 37 |
+
},
|
| 38 |
+
"dev": {
|
| 39 |
+
"cross_attention_adaln": true
|
| 40 |
+
}
|
| 41 |
+
}
|
| 42 |
+
}
|
embedded_config.json
ADDED
|
@@ -0,0 +1,356 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"transformer": {
|
| 3 |
+
"_class_name": "AVTransformer3DModel",
|
| 4 |
+
"activation_fn": "gelu-approximate",
|
| 5 |
+
"attention_bias": true,
|
| 6 |
+
"attention_head_dim": 128,
|
| 7 |
+
"attention_type": "default",
|
| 8 |
+
"caption_channels": 3840,
|
| 9 |
+
"cross_attention_dim": 4096,
|
| 10 |
+
"double_self_attention": false,
|
| 11 |
+
"dropout": 0.0,
|
| 12 |
+
"in_channels": 128,
|
| 13 |
+
"norm_elementwise_affine": false,
|
| 14 |
+
"norm_eps": 1e-06,
|
| 15 |
+
"norm_num_groups": 32,
|
| 16 |
+
"num_attention_heads": 32,
|
| 17 |
+
"num_embeds_ada_norm": 1000,
|
| 18 |
+
"num_layers": 48,
|
| 19 |
+
"num_vector_embeds": null,
|
| 20 |
+
"only_cross_attention": false,
|
| 21 |
+
"cross_attention_norm": true,
|
| 22 |
+
"out_channels": 128,
|
| 23 |
+
"upcast_attention": false,
|
| 24 |
+
"use_linear_projection": false,
|
| 25 |
+
"qk_norm": "rms_norm",
|
| 26 |
+
"standardization_norm": "rms_norm",
|
| 27 |
+
"positional_embedding_type": "rope",
|
| 28 |
+
"positional_embedding_theta": 10000.0,
|
| 29 |
+
"positional_embedding_max_pos": [
|
| 30 |
+
20,
|
| 31 |
+
2048,
|
| 32 |
+
2048
|
| 33 |
+
],
|
| 34 |
+
"timestep_scale_multiplier": 1000,
|
| 35 |
+
"av_ca_timestep_scale_multiplier": 1000.0,
|
| 36 |
+
"causal_temporal_positioning": true,
|
| 37 |
+
"audio_num_attention_heads": 32,
|
| 38 |
+
"audio_attention_head_dim": 64,
|
| 39 |
+
"use_audio_video_cross_attention": true,
|
| 40 |
+
"share_ff": false,
|
| 41 |
+
"audio_out_channels": 128,
|
| 42 |
+
"audio_cross_attention_dim": 2048,
|
| 43 |
+
"audio_positional_embedding_max_pos": [
|
| 44 |
+
20
|
| 45 |
+
],
|
| 46 |
+
"av_cross_ada_norm": true,
|
| 47 |
+
"use_embeddings_connector": true,
|
| 48 |
+
"connector_attention_head_dim": 128,
|
| 49 |
+
"connector_num_attention_heads": 32,
|
| 50 |
+
"connector_num_layers": 8,
|
| 51 |
+
"connector_positional_embedding_max_pos": [
|
| 52 |
+
4096
|
| 53 |
+
],
|
| 54 |
+
"connector_num_learnable_registers": 128,
|
| 55 |
+
"connector_norm_output": true,
|
| 56 |
+
"use_middle_indices_grid": true,
|
| 57 |
+
"apply_gated_attention": true,
|
| 58 |
+
"connector_apply_gated_attention": true,
|
| 59 |
+
"caption_projection_first_linear": false,
|
| 60 |
+
"caption_projection_second_linear": false,
|
| 61 |
+
"caption_proj_input_norm": false,
|
| 62 |
+
"connector_learnable_registers_std": 1,
|
| 63 |
+
"caption_proj_before_connector": true,
|
| 64 |
+
"audio_connector_attention_head_dim": 64,
|
| 65 |
+
"audio_connector_num_attention_heads": 32,
|
| 66 |
+
"cross_attention_adaln": true,
|
| 67 |
+
"text_encoder_norm_type": "per_token_rms",
|
| 68 |
+
"rope_type": "split",
|
| 69 |
+
"frequencies_precision": "float64"
|
| 70 |
+
},
|
| 71 |
+
"vae": {
|
| 72 |
+
"_class_name": "CausalVideoAutoencoder",
|
| 73 |
+
"dims": 3,
|
| 74 |
+
"in_channels": 3,
|
| 75 |
+
"out_channels": 3,
|
| 76 |
+
"latent_channels": 128,
|
| 77 |
+
"encoder_blocks": [
|
| 78 |
+
[
|
| 79 |
+
"res_x",
|
| 80 |
+
{
|
| 81 |
+
"num_layers": 4
|
| 82 |
+
}
|
| 83 |
+
],
|
| 84 |
+
[
|
| 85 |
+
"compress_space_res",
|
| 86 |
+
{
|
| 87 |
+
"multiplier": 2
|
| 88 |
+
}
|
| 89 |
+
],
|
| 90 |
+
[
|
| 91 |
+
"res_x",
|
| 92 |
+
{
|
| 93 |
+
"num_layers": 6
|
| 94 |
+
}
|
| 95 |
+
],
|
| 96 |
+
[
|
| 97 |
+
"compress_time_res",
|
| 98 |
+
{
|
| 99 |
+
"multiplier": 2
|
| 100 |
+
}
|
| 101 |
+
],
|
| 102 |
+
[
|
| 103 |
+
"res_x",
|
| 104 |
+
{
|
| 105 |
+
"num_layers": 4
|
| 106 |
+
}
|
| 107 |
+
],
|
| 108 |
+
[
|
| 109 |
+
"compress_all_res",
|
| 110 |
+
{
|
| 111 |
+
"multiplier": 2
|
| 112 |
+
}
|
| 113 |
+
],
|
| 114 |
+
[
|
| 115 |
+
"res_x",
|
| 116 |
+
{
|
| 117 |
+
"num_layers": 2
|
| 118 |
+
}
|
| 119 |
+
],
|
| 120 |
+
[
|
| 121 |
+
"compress_all_res",
|
| 122 |
+
{
|
| 123 |
+
"multiplier": 1
|
| 124 |
+
}
|
| 125 |
+
],
|
| 126 |
+
[
|
| 127 |
+
"res_x",
|
| 128 |
+
{
|
| 129 |
+
"num_layers": 2
|
| 130 |
+
}
|
| 131 |
+
]
|
| 132 |
+
],
|
| 133 |
+
"decoder_blocks": [
|
| 134 |
+
[
|
| 135 |
+
"res_x",
|
| 136 |
+
{
|
| 137 |
+
"num_layers": 4
|
| 138 |
+
}
|
| 139 |
+
],
|
| 140 |
+
[
|
| 141 |
+
"compress_space",
|
| 142 |
+
{
|
| 143 |
+
"multiplier": 2
|
| 144 |
+
}
|
| 145 |
+
],
|
| 146 |
+
[
|
| 147 |
+
"res_x",
|
| 148 |
+
{
|
| 149 |
+
"num_layers": 6
|
| 150 |
+
}
|
| 151 |
+
],
|
| 152 |
+
[
|
| 153 |
+
"compress_time",
|
| 154 |
+
{
|
| 155 |
+
"multiplier": 2
|
| 156 |
+
}
|
| 157 |
+
],
|
| 158 |
+
[
|
| 159 |
+
"res_x",
|
| 160 |
+
{
|
| 161 |
+
"num_layers": 4
|
| 162 |
+
}
|
| 163 |
+
],
|
| 164 |
+
[
|
| 165 |
+
"compress_all",
|
| 166 |
+
{
|
| 167 |
+
"multiplier": 1
|
| 168 |
+
}
|
| 169 |
+
],
|
| 170 |
+
[
|
| 171 |
+
"res_x",
|
| 172 |
+
{
|
| 173 |
+
"num_layers": 2
|
| 174 |
+
}
|
| 175 |
+
],
|
| 176 |
+
[
|
| 177 |
+
"compress_all",
|
| 178 |
+
{
|
| 179 |
+
"multiplier": 2
|
| 180 |
+
}
|
| 181 |
+
],
|
| 182 |
+
[
|
| 183 |
+
"res_x",
|
| 184 |
+
{
|
| 185 |
+
"num_layers": 2
|
| 186 |
+
}
|
| 187 |
+
]
|
| 188 |
+
],
|
| 189 |
+
"scaling_factor": 1.0,
|
| 190 |
+
"norm_layer": "pixel_norm",
|
| 191 |
+
"patch_size": 4,
|
| 192 |
+
"latent_log_var": "uniform",
|
| 193 |
+
"use_quant_conv": false,
|
| 194 |
+
"causal_decoder": false,
|
| 195 |
+
"timestep_conditioning": false,
|
| 196 |
+
"normalize_latent_channels": false,
|
| 197 |
+
"encoder_base_channels": 128,
|
| 198 |
+
"decoder_base_channels": 128,
|
| 199 |
+
"spatial_padding_mode": "zeros"
|
| 200 |
+
},
|
| 201 |
+
"scheduler": {
|
| 202 |
+
"_class_name": "RectifiedFlowScheduler",
|
| 203 |
+
"_diffusers_version": "0.25.1",
|
| 204 |
+
"num_train_timesteps": 1000,
|
| 205 |
+
"shifting": null,
|
| 206 |
+
"base_resolution": null,
|
| 207 |
+
"sampler": "LinearQuadratic"
|
| 208 |
+
},
|
| 209 |
+
"audio_vae": {
|
| 210 |
+
"model": {
|
| 211 |
+
"params": {
|
| 212 |
+
"ddconfig": {
|
| 213 |
+
"double_z": true,
|
| 214 |
+
"mel_bins": 64,
|
| 215 |
+
"z_channels": 8,
|
| 216 |
+
"resolution": 256,
|
| 217 |
+
"downsample_time": false,
|
| 218 |
+
"in_channels": 2,
|
| 219 |
+
"out_ch": 2,
|
| 220 |
+
"ch": 128,
|
| 221 |
+
"ch_mult": [
|
| 222 |
+
1,
|
| 223 |
+
2,
|
| 224 |
+
4
|
| 225 |
+
],
|
| 226 |
+
"num_res_blocks": 2,
|
| 227 |
+
"attn_resolutions": [],
|
| 228 |
+
"dropout": 0.0,
|
| 229 |
+
"mid_block_add_attention": false,
|
| 230 |
+
"norm_type": "pixel",
|
| 231 |
+
"causality_axis": "height"
|
| 232 |
+
},
|
| 233 |
+
"sampling_rate": 16000
|
| 234 |
+
}
|
| 235 |
+
},
|
| 236 |
+
"preprocessing": {
|
| 237 |
+
"audio": {
|
| 238 |
+
"sampling_rate": 16000,
|
| 239 |
+
"max_wav_value": 32768.0,
|
| 240 |
+
"duration": 5.12,
|
| 241 |
+
"stereo": true,
|
| 242 |
+
"causal_padding": 3
|
| 243 |
+
},
|
| 244 |
+
"stft": {
|
| 245 |
+
"filter_length": 1024,
|
| 246 |
+
"hop_length": 160,
|
| 247 |
+
"win_length": 1024,
|
| 248 |
+
"causal": true
|
| 249 |
+
},
|
| 250 |
+
"mel": {
|
| 251 |
+
"n_mel_channels": 64,
|
| 252 |
+
"mel_fmin": 0,
|
| 253 |
+
"mel_fmax": 8000
|
| 254 |
+
}
|
| 255 |
+
}
|
| 256 |
+
},
|
| 257 |
+
"vocoder": {
|
| 258 |
+
"vocoder": {
|
| 259 |
+
"upsample_initial_channel": 1536,
|
| 260 |
+
"resblock": "AMP1",
|
| 261 |
+
"upsample_rates": [
|
| 262 |
+
5,
|
| 263 |
+
2,
|
| 264 |
+
2,
|
| 265 |
+
2,
|
| 266 |
+
2,
|
| 267 |
+
2
|
| 268 |
+
],
|
| 269 |
+
"resblock_kernel_sizes": [
|
| 270 |
+
3,
|
| 271 |
+
7,
|
| 272 |
+
11
|
| 273 |
+
],
|
| 274 |
+
"upsample_kernel_sizes": [
|
| 275 |
+
11,
|
| 276 |
+
4,
|
| 277 |
+
4,
|
| 278 |
+
4,
|
| 279 |
+
4,
|
| 280 |
+
4
|
| 281 |
+
],
|
| 282 |
+
"resblock_dilation_sizes": [
|
| 283 |
+
[
|
| 284 |
+
1,
|
| 285 |
+
3,
|
| 286 |
+
5
|
| 287 |
+
],
|
| 288 |
+
[
|
| 289 |
+
1,
|
| 290 |
+
3,
|
| 291 |
+
5
|
| 292 |
+
],
|
| 293 |
+
[
|
| 294 |
+
1,
|
| 295 |
+
3,
|
| 296 |
+
5
|
| 297 |
+
]
|
| 298 |
+
],
|
| 299 |
+
"stereo": true,
|
| 300 |
+
"use_tanh_at_final": false,
|
| 301 |
+
"activation": "snakebeta",
|
| 302 |
+
"use_bias_at_final": false
|
| 303 |
+
},
|
| 304 |
+
"bwe": {
|
| 305 |
+
"upsample_initial_channel": 512,
|
| 306 |
+
"resblock": "AMP1",
|
| 307 |
+
"upsample_rates": [
|
| 308 |
+
6,
|
| 309 |
+
5,
|
| 310 |
+
2,
|
| 311 |
+
2,
|
| 312 |
+
2
|
| 313 |
+
],
|
| 314 |
+
"resblock_kernel_sizes": [
|
| 315 |
+
3,
|
| 316 |
+
7,
|
| 317 |
+
11
|
| 318 |
+
],
|
| 319 |
+
"upsample_kernel_sizes": [
|
| 320 |
+
12,
|
| 321 |
+
11,
|
| 322 |
+
4,
|
| 323 |
+
4,
|
| 324 |
+
4
|
| 325 |
+
],
|
| 326 |
+
"resblock_dilation_sizes": [
|
| 327 |
+
[
|
| 328 |
+
1,
|
| 329 |
+
3,
|
| 330 |
+
5
|
| 331 |
+
],
|
| 332 |
+
[
|
| 333 |
+
1,
|
| 334 |
+
3,
|
| 335 |
+
5
|
| 336 |
+
],
|
| 337 |
+
[
|
| 338 |
+
1,
|
| 339 |
+
3,
|
| 340 |
+
5
|
| 341 |
+
]
|
| 342 |
+
],
|
| 343 |
+
"stereo": true,
|
| 344 |
+
"use_tanh_at_final": false,
|
| 345 |
+
"activation": "snakebeta",
|
| 346 |
+
"use_bias_at_final": false,
|
| 347 |
+
"apply_final_activation": false,
|
| 348 |
+
"input_sampling_rate": 16000,
|
| 349 |
+
"output_sampling_rate": 48000,
|
| 350 |
+
"hop_length": 80,
|
| 351 |
+
"n_fft": 512,
|
| 352 |
+
"win_size": 512,
|
| 353 |
+
"num_mels": 64
|
| 354 |
+
}
|
| 355 |
+
}
|
| 356 |
+
}
|
spatial_upscaler_x1_5_v1_0_config.json
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"config": {
|
| 3 |
+
"_class_name": "LatentUpsampler",
|
| 4 |
+
"in_channels": 128,
|
| 5 |
+
"mid_channels": 1024,
|
| 6 |
+
"num_blocks_per_stage": 4,
|
| 7 |
+
"dims": 3,
|
| 8 |
+
"spatial_upsample": true,
|
| 9 |
+
"temporal_upsample": false,
|
| 10 |
+
"spatial_scale": 1.5,
|
| 11 |
+
"rational_resampler": true
|
| 12 |
+
}
|
| 13 |
+
}
|
spatial_upscaler_x2_v1_1_config.json
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"config": {
|
| 3 |
+
"_class_name": "LatentUpsampler",
|
| 4 |
+
"in_channels": 128,
|
| 5 |
+
"mid_channels": 1024,
|
| 6 |
+
"num_blocks_per_stage": 4,
|
| 7 |
+
"dims": 3,
|
| 8 |
+
"spatial_upsample": true,
|
| 9 |
+
"temporal_upsample": false,
|
| 10 |
+
"spatial_scale": 2.0,
|
| 11 |
+
"rational_resampler": false
|
| 12 |
+
}
|
| 13 |
+
}
|
split_model.json
ADDED
|
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"format": "split",
|
| 3 |
+
"model_version": "2.3.0",
|
| 4 |
+
"components": [
|
| 5 |
+
"connector",
|
| 6 |
+
"vae_decoder",
|
| 7 |
+
"vae_encoder",
|
| 8 |
+
"audio_vae",
|
| 9 |
+
"vocoder",
|
| 10 |
+
"spatial_upscaler_x2_v1_1",
|
| 11 |
+
"spatial_upscaler_x1_5_v1_0",
|
| 12 |
+
"temporal_upscaler_x2_v1_0"
|
| 13 |
+
],
|
| 14 |
+
"transformer_variants": [
|
| 15 |
+
"distilled",
|
| 16 |
+
"dev"
|
| 17 |
+
],
|
| 18 |
+
"lora": [
|
| 19 |
+
"ltx-2.3-22b-distilled-lora-384.safetensors"
|
| 20 |
+
],
|
| 21 |
+
"source": "Lightricks/LTX-2.3",
|
| 22 |
+
"notes": {
|
| 23 |
+
"vocoder": "Also contains BWE (bandwidth extension) generator weights \u2014 upsample layers [6,5,2,2,2] (240x) and mel_stft parameters."
|
| 24 |
+
},
|
| 25 |
+
"recipe": "ltx-2.3",
|
| 26 |
+
"license": "other",
|
| 27 |
+
"links": [
|
| 28 |
+
"Code: https://github.com/dgrauet/ltx-2-mlx",
|
| 29 |
+
"ComfyUI compatible custom nodes: https://github.com/dgrauet/ComfyUI-LTXVideo-mlx"
|
| 30 |
+
],
|
| 31 |
+
"usage_url": "https://github.com/dgrauet/ltx-2-mlx",
|
| 32 |
+
"usage_note": "a native MLX inference pipeline for LTX-2.3 on Apple Silicon"
|
| 33 |
+
}
|
temporal_upscaler_x2_v1_0_config.json
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"config": {
|
| 3 |
+
"_class_name": "LatentUpsampler",
|
| 4 |
+
"in_channels": 128,
|
| 5 |
+
"mid_channels": 512,
|
| 6 |
+
"num_blocks_per_stage": 4,
|
| 7 |
+
"dims": 3,
|
| 8 |
+
"spatial_upsample": false,
|
| 9 |
+
"temporal_upsample": true,
|
| 10 |
+
"spatial_scale": 1.0,
|
| 11 |
+
"rational_resampler": true
|
| 12 |
+
}
|
| 13 |
+
}
|