Image-to-3D
MLX
Safetensors
gaussian-splatting
3dgs
research-only
non-commercial
tamarher commited on
Commit
3fa85c2
·
verified ·
1 Parent(s): 3345347

Add model card and conversion metadata

Browse files
LICENSE_MODEL ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Disclaimer: IMPORTANT: This Apple Machine Learning Research Model is
2
+ specifically developed and released by Apple Inc. ("Apple") for the sole purpose
3
+ of scientific research of artificial intelligence and machine-learning
4
+ technology. “Apple Machine Learning Research Model” means the model, including
5
+ but not limited to algorithms, formulas, trained model weights, parameters,
6
+ configurations, checkpoints, and any related materials (including
7
+ documentation).
8
+
9
+ This Apple Machine Learning Research Model is provided to You by
10
+ Apple in consideration of your agreement to the following terms, and your use,
11
+ modification, creation of Model Derivatives, and or redistribution of the Apple
12
+ Machine Learning Research Model constitutes acceptance of this Agreement. If You
13
+ do not agree with these terms, please do not use, modify, create Model
14
+ Derivatives of, or distribute this Apple Machine Learning Research Model or
15
+ Model Derivatives.
16
+
17
+ * License Scope: In consideration of your agreement to abide by the following
18
+ terms, and subject to these terms, Apple hereby grants you a personal,
19
+ non-exclusive, worldwide, non-transferable, royalty-free, revocable, and
20
+ limited license, to use, copy, modify, distribute, and create Model
21
+ Derivatives (defined below) of the Apple Machine Learning Research Model
22
+ exclusively for Research Purposes. You agree that any Model Derivatives You
23
+ may create or that may be created for You will be limited to Research Purposes
24
+ as well. “Research Purposes” means non-commercial scientific research and
25
+ academic development activities, such as experimentation, analysis, testing
26
+ conducted by You with the sole intent to advance scientific knowledge and
27
+ research. “Research Purposes” does not include any commercial exploitation,
28
+ product development or use in any commercial product or service.
29
+
30
+ * Distribution of Apple Machine Learning Research Model and Model Derivatives:
31
+ If you choose to redistribute Apple Machine Learning Research Model or its
32
+ Model Derivatives, you must provide a copy of this Agreement to such third
33
+ party, and ensure that the following attribution notice be provided: “Apple
34
+ Machine Learning Research Model is licensed under the Apple Machine Learning
35
+ Research Model License Agreement.” Additionally, all Model Derivatives must
36
+ clearly be identified as such, including disclosure of modifications and
37
+ changes made to the Apple Machine Learning Research Model. The name,
38
+ trademarks, service marks or logos of Apple may not be used to endorse or
39
+ promote Model Derivatives or the relationship between You and Apple. “Model
40
+ Derivatives” means any models or any other artifacts created by modifications,
41
+ improvements, adaptations, alterations to the architecture, algorithm or
42
+ training processes of the Apple Machine Learning Research Model, or by any
43
+ retraining, fine-tuning of the Apple Machine Learning Research Model.
44
+
45
+ * No Other License: Except as expressly stated in this notice, no other rights
46
+ or licenses, express or implied, are granted by Apple herein, including but
47
+ not limited to any patent, trademark, and similar intellectual property rights
48
+ worldwide that may be infringed by the Apple Machine Learning Research Model,
49
+ the Model Derivatives or by other works in which the Apple Machine Learning
50
+ Research Model may be incorporated.
51
+
52
+ * Compliance with Laws: Your use of Apple Machine Learning Research Model must
53
+ be in compliance with all applicable laws and regulations.
54
+
55
+ * Term and Termination: The term of this Agreement will begin upon your
56
+ acceptance of this Agreement or use of the Apple Machine Learning Research
57
+ Model and will continue until terminated in accordance with the following
58
+ terms. Apple may terminate this Agreement at any time if You are in breach of
59
+ any term or condition of this Agreement. Upon termination of this Agreement,
60
+ You must cease to use all Apple Machine Learning Research Models and Model
61
+ Derivatives and permanently delete any copy thereof. Sections 3, 6 and 7 will
62
+ survive termination.
63
+
64
+ * Disclaimer and Limitation of Liability: This Apple Machine Learning Research
65
+ Model and any outputs generated by the Apple Machine Learning Research Model
66
+ are provided on an “AS IS” basis. APPLE MAKES NO WARRANTIES, EXPRESS OR
67
+ IMPLIED, INCLUDING WITHOUT LIMITATION THE IMPLIED WARRANTIES OF
68
+ NON-INFRINGEMENT, MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE,
69
+ REGARDING THE APPLE MACHINE LEARNING RESEARCH MODEL OR OUTPUTS GENERATED BY
70
+ THE APPLE MACHINE LEARNING RESEARCH MODEL. You are solely responsible for
71
+ determining the appropriateness of using or redistributing the Apple Machine
72
+ Learning Research Model and any outputs of the Apple Machine Learning Research
73
+ Model and assume any risks associated with Your use of the Apple Machine
74
+ Learning Research Model and any output and results. IN NO EVENT SHALL APPLE BE
75
+ LIABLE FOR ANY SPECIAL, INDIRECT, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING
76
+ IN ANY WAY OUT OF THE USE, REPRODUCTION, MODIFICATION AND/OR DISTRIBUTION OF
77
+ THE APPLE MACHINE LEARNING RESEARCH MODEL AND ANY OUTPUTS OF THE APPLE MACHINE
78
+ LEARNING RESEARCH MODEL, HOWEVER CAUSED AND WHETHER UNDER THEORY OF CONTRACT,
79
+ TORT (INCLUDING NEGLIGENCE), STRICT LIABILITY OR OTHERWISE, EVEN IF APPLE HAS
80
+ BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
81
+
82
+ * Governing Law: This Agreement will be governed by and construed under the laws
83
+ of the State of California without regard to its choice of law principles. The
84
+ Convention on Contracts for the International Sale of Goods shall not apply to
85
+ the Agreement except that the arbitration clause and any arbitration hereunder
86
+ shall be governed by the Federal Arbitration Act, Chapters 1 and 2.
87
+
88
+ Copyright (C) 2026 Apple Inc. All Rights Reserved.
README.md ADDED
@@ -0,0 +1,106 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: apple-machine-learning-research-model-license-agreement
4
+ license_link: https://github.com/apple/ml-lito/blob/main/LICENSE_MODEL
5
+ library_name: mlx
6
+ pipeline_tag: image-to-3d
7
+ tags:
8
+ - mlx
9
+ - safetensors
10
+ - image-to-3d
11
+ - gaussian-splatting
12
+ - 3dgs
13
+ - research-only
14
+ - non-commercial
15
+ base_model:
16
+ - apple/ml-lito
17
+ ---
18
+
19
+ # LiTo Research MLX Safetensors
20
+
21
+ Unofficial MLX-compatible safetensors conversion of Apple's LiTo research checkpoints for non-commercial research use with `mlx-spatial`.
22
+
23
+ This repository is not an Apple release and is not endorsed by Apple. The converted files preserve the released checkpoint tensors and change only the storage format and local layout needed for MLX loading in `mlx-spatial`.
24
+
25
+ ## License
26
+
27
+ Apple's LiTo model weights are released under the Apple Machine Learning Research Model License Agreement:
28
+
29
+ https://github.com/apple/ml-lito/blob/main/LICENSE_MODEL
30
+
31
+ Use is limited to non-commercial scientific research and academic development activities. Commercial product use is not permitted. Redistribution of this converted bundle must keep Apple's license terms, attribution notice, and modification disclosure.
32
+
33
+ Attribution notice required by the Apple license:
34
+
35
+ > Apple Machine Learning Research Model is licensed under the Apple Machine Learning Research Model License Agreement.
36
+
37
+ ## Source
38
+
39
+ - Source project: https://apple.github.io/ml-lito/
40
+ - Source code: https://github.com/apple/ml-lito
41
+ - Source checkpoints: Apple's LiTo checkpoint downloads referenced by the upstream project.
42
+ - Runtime package: `mlx-spatial`
43
+ - `mlx-spatial` source: https://github.com/appautomaton/mlx-spatial
44
+ - `mlx-spatial` PyPI package: https://pypi.org/project/mlx-spatial/
45
+
46
+ ## Conversion
47
+
48
+ The files in this repository were converted from Apple's original `.ckpt` files to safetensors for local MLX loading. No training, fine-tuning, quantization, pruning, or tensor-value modification was applied.
49
+
50
+ Expected converted layout:
51
+
52
+ ```text
53
+ tokenizer/lito_new.safetensors
54
+ image_to_3d/lito_dit_rgba.safetensors
55
+ ```
56
+
57
+ Optional conversion metadata may be included under:
58
+
59
+ ```text
60
+ tokenizer/conversion_metadata/lito_new.yaml
61
+ image_to_3d/conversion_metadata/lito_dit_rgba.yaml
62
+ ```
63
+
64
+ These two safetensors are the LiTo-specific checkpoint files required by `mlx-spatial-lito validate`. End-to-end generation in `mlx-spatial` also needs the TRELLIS sparse-structure decoder weights from the separate TRELLIS.2 setup; those are not included in this LiTo bundle.
65
+
66
+ ## Use With mlx-spatial
67
+
68
+ Install `mlx-spatial`:
69
+
70
+ ```bash
71
+ pip install mlx-spatial
72
+ ```
73
+
74
+ Download this model bundle:
75
+
76
+ ```bash
77
+ hf download appautomaton/lito-research-mlx \
78
+ --local-dir weights/lito-research-mlx
79
+ ```
80
+
81
+ Validate the local layout:
82
+
83
+ ```bash
84
+ mlx-spatial-lito validate weights/lito-research-mlx
85
+ mlx-spatial-lito inspect weights/lito-research-mlx --limit 10
86
+ ```
87
+
88
+ Generate a Gaussian-splat PLY:
89
+
90
+ ```bash
91
+ mlx-spatial-lito generate inputs/lito/sample.png \
92
+ --weights-root weights/lito-research-mlx \
93
+ --output outputs/lito/sample.ply \
94
+ --memory-profile safe \
95
+ --print-metrics
96
+ ```
97
+
98
+ The output is a 3D Gaussian Splat PLY, not a mesh. Use a 3DGS-aware viewer such as KIRI Engine's 3DGS Render Blender add-on. Blender's native PLY importer can read the container but does not render LiTo Gaussian splat fields correctly.
99
+
100
+ ## Known Limitations
101
+
102
+ - Research-only, non-commercial license boundary from Apple.
103
+ - This is a converted derivative bundle, not an Apple-hosted official MLX package.
104
+ - Current `mlx-spatial` LiTo support targets image-to-3D Gaussian splat inference; it does not provide LiTo training, fine-tuning, mesh extraction, multi-image conditioning, or video conditioning.
105
+ - Visual quality depends strongly on input matting and alpha quality. Inputs with broad or noisy alpha masks can produce weaker holes, handles, and fine structures.
106
+ - CUDA is not required and is not used by `mlx-spatial` LiTo inference.
image_to_3d/conversion_metadata/lito_dit_rgba.yaml ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ source: weights/lito-raw/lito_dit_rgba.ckpt
2
+ converter: torch.load-map-location-cpu
3
+ pt_safe_loader_error: RuntimeError: invalid checkpoint structure: BUILD with non-empty state is not supported
4
+ tensor_count: 2793
tokenizer/conversion_metadata/lito_new.yaml ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ source: weights/lito-raw/lito_new.ckpt
2
+ converter: torch.load-map-location-cpu
3
+ pt_safe_loader_error: RuntimeError: invalid checkpoint structure: BUILD with non-empty state is not supported
4
+ tensor_count: 1108