Instructions to use appautomaton/lito-research-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use appautomaton/lito-research-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir lito-research-mlx appautomaton/lito-research-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Add model card and conversion metadata
Browse files- LICENSE_MODEL +88 -0
- README.md +106 -0
- image_to_3d/conversion_metadata/lito_dit_rgba.yaml +4 -0
- tokenizer/conversion_metadata/lito_new.yaml +4 -0
LICENSE_MODEL
ADDED
|
@@ -0,0 +1,88 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Disclaimer: IMPORTANT: This Apple Machine Learning Research Model is
|
| 2 |
+
specifically developed and released by Apple Inc. ("Apple") for the sole purpose
|
| 3 |
+
of scientific research of artificial intelligence and machine-learning
|
| 4 |
+
technology. “Apple Machine Learning Research Model” means the model, including
|
| 5 |
+
but not limited to algorithms, formulas, trained model weights, parameters,
|
| 6 |
+
configurations, checkpoints, and any related materials (including
|
| 7 |
+
documentation).
|
| 8 |
+
|
| 9 |
+
This Apple Machine Learning Research Model is provided to You by
|
| 10 |
+
Apple in consideration of your agreement to the following terms, and your use,
|
| 11 |
+
modification, creation of Model Derivatives, and or redistribution of the Apple
|
| 12 |
+
Machine Learning Research Model constitutes acceptance of this Agreement. If You
|
| 13 |
+
do not agree with these terms, please do not use, modify, create Model
|
| 14 |
+
Derivatives of, or distribute this Apple Machine Learning Research Model or
|
| 15 |
+
Model Derivatives.
|
| 16 |
+
|
| 17 |
+
* License Scope: In consideration of your agreement to abide by the following
|
| 18 |
+
terms, and subject to these terms, Apple hereby grants you a personal,
|
| 19 |
+
non-exclusive, worldwide, non-transferable, royalty-free, revocable, and
|
| 20 |
+
limited license, to use, copy, modify, distribute, and create Model
|
| 21 |
+
Derivatives (defined below) of the Apple Machine Learning Research Model
|
| 22 |
+
exclusively for Research Purposes. You agree that any Model Derivatives You
|
| 23 |
+
may create or that may be created for You will be limited to Research Purposes
|
| 24 |
+
as well. “Research Purposes” means non-commercial scientific research and
|
| 25 |
+
academic development activities, such as experimentation, analysis, testing
|
| 26 |
+
conducted by You with the sole intent to advance scientific knowledge and
|
| 27 |
+
research. “Research Purposes” does not include any commercial exploitation,
|
| 28 |
+
product development or use in any commercial product or service.
|
| 29 |
+
|
| 30 |
+
* Distribution of Apple Machine Learning Research Model and Model Derivatives:
|
| 31 |
+
If you choose to redistribute Apple Machine Learning Research Model or its
|
| 32 |
+
Model Derivatives, you must provide a copy of this Agreement to such third
|
| 33 |
+
party, and ensure that the following attribution notice be provided: “Apple
|
| 34 |
+
Machine Learning Research Model is licensed under the Apple Machine Learning
|
| 35 |
+
Research Model License Agreement.” Additionally, all Model Derivatives must
|
| 36 |
+
clearly be identified as such, including disclosure of modifications and
|
| 37 |
+
changes made to the Apple Machine Learning Research Model. The name,
|
| 38 |
+
trademarks, service marks or logos of Apple may not be used to endorse or
|
| 39 |
+
promote Model Derivatives or the relationship between You and Apple. “Model
|
| 40 |
+
Derivatives” means any models or any other artifacts created by modifications,
|
| 41 |
+
improvements, adaptations, alterations to the architecture, algorithm or
|
| 42 |
+
training processes of the Apple Machine Learning Research Model, or by any
|
| 43 |
+
retraining, fine-tuning of the Apple Machine Learning Research Model.
|
| 44 |
+
|
| 45 |
+
* No Other License: Except as expressly stated in this notice, no other rights
|
| 46 |
+
or licenses, express or implied, are granted by Apple herein, including but
|
| 47 |
+
not limited to any patent, trademark, and similar intellectual property rights
|
| 48 |
+
worldwide that may be infringed by the Apple Machine Learning Research Model,
|
| 49 |
+
the Model Derivatives or by other works in which the Apple Machine Learning
|
| 50 |
+
Research Model may be incorporated.
|
| 51 |
+
|
| 52 |
+
* Compliance with Laws: Your use of Apple Machine Learning Research Model must
|
| 53 |
+
be in compliance with all applicable laws and regulations.
|
| 54 |
+
|
| 55 |
+
* Term and Termination: The term of this Agreement will begin upon your
|
| 56 |
+
acceptance of this Agreement or use of the Apple Machine Learning Research
|
| 57 |
+
Model and will continue until terminated in accordance with the following
|
| 58 |
+
terms. Apple may terminate this Agreement at any time if You are in breach of
|
| 59 |
+
any term or condition of this Agreement. Upon termination of this Agreement,
|
| 60 |
+
You must cease to use all Apple Machine Learning Research Models and Model
|
| 61 |
+
Derivatives and permanently delete any copy thereof. Sections 3, 6 and 7 will
|
| 62 |
+
survive termination.
|
| 63 |
+
|
| 64 |
+
* Disclaimer and Limitation of Liability: This Apple Machine Learning Research
|
| 65 |
+
Model and any outputs generated by the Apple Machine Learning Research Model
|
| 66 |
+
are provided on an “AS IS” basis. APPLE MAKES NO WARRANTIES, EXPRESS OR
|
| 67 |
+
IMPLIED, INCLUDING WITHOUT LIMITATION THE IMPLIED WARRANTIES OF
|
| 68 |
+
NON-INFRINGEMENT, MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE,
|
| 69 |
+
REGARDING THE APPLE MACHINE LEARNING RESEARCH MODEL OR OUTPUTS GENERATED BY
|
| 70 |
+
THE APPLE MACHINE LEARNING RESEARCH MODEL. You are solely responsible for
|
| 71 |
+
determining the appropriateness of using or redistributing the Apple Machine
|
| 72 |
+
Learning Research Model and any outputs of the Apple Machine Learning Research
|
| 73 |
+
Model and assume any risks associated with Your use of the Apple Machine
|
| 74 |
+
Learning Research Model and any output and results. IN NO EVENT SHALL APPLE BE
|
| 75 |
+
LIABLE FOR ANY SPECIAL, INDIRECT, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING
|
| 76 |
+
IN ANY WAY OUT OF THE USE, REPRODUCTION, MODIFICATION AND/OR DISTRIBUTION OF
|
| 77 |
+
THE APPLE MACHINE LEARNING RESEARCH MODEL AND ANY OUTPUTS OF THE APPLE MACHINE
|
| 78 |
+
LEARNING RESEARCH MODEL, HOWEVER CAUSED AND WHETHER UNDER THEORY OF CONTRACT,
|
| 79 |
+
TORT (INCLUDING NEGLIGENCE), STRICT LIABILITY OR OTHERWISE, EVEN IF APPLE HAS
|
| 80 |
+
BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
|
| 81 |
+
|
| 82 |
+
* Governing Law: This Agreement will be governed by and construed under the laws
|
| 83 |
+
of the State of California without regard to its choice of law principles. The
|
| 84 |
+
Convention on Contracts for the International Sale of Goods shall not apply to
|
| 85 |
+
the Agreement except that the arbitration clause and any arbitration hereunder
|
| 86 |
+
shall be governed by the Federal Arbitration Act, Chapters 1 and 2.
|
| 87 |
+
|
| 88 |
+
Copyright (C) 2026 Apple Inc. All Rights Reserved.
|
README.md
ADDED
|
@@ -0,0 +1,106 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: apple-machine-learning-research-model-license-agreement
|
| 4 |
+
license_link: https://github.com/apple/ml-lito/blob/main/LICENSE_MODEL
|
| 5 |
+
library_name: mlx
|
| 6 |
+
pipeline_tag: image-to-3d
|
| 7 |
+
tags:
|
| 8 |
+
- mlx
|
| 9 |
+
- safetensors
|
| 10 |
+
- image-to-3d
|
| 11 |
+
- gaussian-splatting
|
| 12 |
+
- 3dgs
|
| 13 |
+
- research-only
|
| 14 |
+
- non-commercial
|
| 15 |
+
base_model:
|
| 16 |
+
- apple/ml-lito
|
| 17 |
+
---
|
| 18 |
+
|
| 19 |
+
# LiTo Research MLX Safetensors
|
| 20 |
+
|
| 21 |
+
Unofficial MLX-compatible safetensors conversion of Apple's LiTo research checkpoints for non-commercial research use with `mlx-spatial`.
|
| 22 |
+
|
| 23 |
+
This repository is not an Apple release and is not endorsed by Apple. The converted files preserve the released checkpoint tensors and change only the storage format and local layout needed for MLX loading in `mlx-spatial`.
|
| 24 |
+
|
| 25 |
+
## License
|
| 26 |
+
|
| 27 |
+
Apple's LiTo model weights are released under the Apple Machine Learning Research Model License Agreement:
|
| 28 |
+
|
| 29 |
+
https://github.com/apple/ml-lito/blob/main/LICENSE_MODEL
|
| 30 |
+
|
| 31 |
+
Use is limited to non-commercial scientific research and academic development activities. Commercial product use is not permitted. Redistribution of this converted bundle must keep Apple's license terms, attribution notice, and modification disclosure.
|
| 32 |
+
|
| 33 |
+
Attribution notice required by the Apple license:
|
| 34 |
+
|
| 35 |
+
> Apple Machine Learning Research Model is licensed under the Apple Machine Learning Research Model License Agreement.
|
| 36 |
+
|
| 37 |
+
## Source
|
| 38 |
+
|
| 39 |
+
- Source project: https://apple.github.io/ml-lito/
|
| 40 |
+
- Source code: https://github.com/apple/ml-lito
|
| 41 |
+
- Source checkpoints: Apple's LiTo checkpoint downloads referenced by the upstream project.
|
| 42 |
+
- Runtime package: `mlx-spatial`
|
| 43 |
+
- `mlx-spatial` source: https://github.com/appautomaton/mlx-spatial
|
| 44 |
+
- `mlx-spatial` PyPI package: https://pypi.org/project/mlx-spatial/
|
| 45 |
+
|
| 46 |
+
## Conversion
|
| 47 |
+
|
| 48 |
+
The files in this repository were converted from Apple's original `.ckpt` files to safetensors for local MLX loading. No training, fine-tuning, quantization, pruning, or tensor-value modification was applied.
|
| 49 |
+
|
| 50 |
+
Expected converted layout:
|
| 51 |
+
|
| 52 |
+
```text
|
| 53 |
+
tokenizer/lito_new.safetensors
|
| 54 |
+
image_to_3d/lito_dit_rgba.safetensors
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
Optional conversion metadata may be included under:
|
| 58 |
+
|
| 59 |
+
```text
|
| 60 |
+
tokenizer/conversion_metadata/lito_new.yaml
|
| 61 |
+
image_to_3d/conversion_metadata/lito_dit_rgba.yaml
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
These two safetensors are the LiTo-specific checkpoint files required by `mlx-spatial-lito validate`. End-to-end generation in `mlx-spatial` also needs the TRELLIS sparse-structure decoder weights from the separate TRELLIS.2 setup; those are not included in this LiTo bundle.
|
| 65 |
+
|
| 66 |
+
## Use With mlx-spatial
|
| 67 |
+
|
| 68 |
+
Install `mlx-spatial`:
|
| 69 |
+
|
| 70 |
+
```bash
|
| 71 |
+
pip install mlx-spatial
|
| 72 |
+
```
|
| 73 |
+
|
| 74 |
+
Download this model bundle:
|
| 75 |
+
|
| 76 |
+
```bash
|
| 77 |
+
hf download appautomaton/lito-research-mlx \
|
| 78 |
+
--local-dir weights/lito-research-mlx
|
| 79 |
+
```
|
| 80 |
+
|
| 81 |
+
Validate the local layout:
|
| 82 |
+
|
| 83 |
+
```bash
|
| 84 |
+
mlx-spatial-lito validate weights/lito-research-mlx
|
| 85 |
+
mlx-spatial-lito inspect weights/lito-research-mlx --limit 10
|
| 86 |
+
```
|
| 87 |
+
|
| 88 |
+
Generate a Gaussian-splat PLY:
|
| 89 |
+
|
| 90 |
+
```bash
|
| 91 |
+
mlx-spatial-lito generate inputs/lito/sample.png \
|
| 92 |
+
--weights-root weights/lito-research-mlx \
|
| 93 |
+
--output outputs/lito/sample.ply \
|
| 94 |
+
--memory-profile safe \
|
| 95 |
+
--print-metrics
|
| 96 |
+
```
|
| 97 |
+
|
| 98 |
+
The output is a 3D Gaussian Splat PLY, not a mesh. Use a 3DGS-aware viewer such as KIRI Engine's 3DGS Render Blender add-on. Blender's native PLY importer can read the container but does not render LiTo Gaussian splat fields correctly.
|
| 99 |
+
|
| 100 |
+
## Known Limitations
|
| 101 |
+
|
| 102 |
+
- Research-only, non-commercial license boundary from Apple.
|
| 103 |
+
- This is a converted derivative bundle, not an Apple-hosted official MLX package.
|
| 104 |
+
- Current `mlx-spatial` LiTo support targets image-to-3D Gaussian splat inference; it does not provide LiTo training, fine-tuning, mesh extraction, multi-image conditioning, or video conditioning.
|
| 105 |
+
- Visual quality depends strongly on input matting and alpha quality. Inputs with broad or noisy alpha masks can produce weaker holes, handles, and fine structures.
|
| 106 |
+
- CUDA is not required and is not used by `mlx-spatial` LiTo inference.
|
image_to_3d/conversion_metadata/lito_dit_rgba.yaml
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
source: weights/lito-raw/lito_dit_rgba.ckpt
|
| 2 |
+
converter: torch.load-map-location-cpu
|
| 3 |
+
pt_safe_loader_error: RuntimeError: invalid checkpoint structure: BUILD with non-empty state is not supported
|
| 4 |
+
tensor_count: 2793
|
tokenizer/conversion_metadata/lito_new.yaml
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
source: weights/lito-raw/lito_new.ckpt
|
| 2 |
+
converter: torch.load-map-location-cpu
|
| 3 |
+
pt_safe_loader_error: RuntimeError: invalid checkpoint structure: BUILD with non-empty state is not supported
|
| 4 |
+
tensor_count: 1108
|