Add model card for NativeTok

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +53 -0
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: image-to-image
3
+ ---
4
+
5
+ # NativeTok: Native Visual Tokenization for Improved Image Generation
6
+
7
+ This repository contains the official weights for NativeTok, a framework that enforces causal dependencies during tokenization to improve generative modeling coherence and performance.
8
+
9
+ [**Paper**](https://huggingface.co/papers/2601.22837) | [**GitHub**](https://github.com/wangbei1/Nativetok)
10
+
11
+ ## Introduction
12
+
13
+ NativeTok consists of a Meta Image Transformer (MIT) for latent image modeling and a Mixture of Causal Expert Transformer (MoCET), where each lightweight expert block generates a single token conditioned on prior tokens and latent features. This approach addresses the mismatch between tokenization and generative modeling by embedding relational constraints within token sequences.
14
+
15
+ ## 📌 Model Checkpoints
16
+
17
+ These weights are trained based on the MaskGIT architecture with OrderTok tokenization strategies.
18
+
19
+ | File Name | Description | Resolution |
20
+ | :--- | :--- | :--- |
21
+ | **`maskgit128_ordertok.bin`** | MaskGIT | 256x256 |
22
+ | **`Nativetok_128_300000_stage2.bin`** | Nativetok_128 checkpoint | 256x256 |
23
+
24
+ ## 🚀 Quick Start
25
+
26
+ ### Download Weights
27
+ You can use `huggingface_hub` to download the weights directly:
28
+
29
+ ```python
30
+ from huggingface_hub import hf_hub_download
31
+
32
+ # Download the main weight
33
+ checkpoint_path = hf_hub_download(
34
+ repo_id="wangbei1/Nativetok",
35
+ filename="maskgit128_ordertok.bin"
36
+ )
37
+
38
+ print(f"Model downloaded to: {checkpoint_path}")
39
+ ```
40
+
41
+ ## Related Resources
42
+ Base Framework (1D-Tokenizer): [1D-Tokenizer](https://yucornetto.github.io/projects/titok.html)
43
+
44
+ ## Citation
45
+
46
+ ```bibtex
47
+ @article{wu2026nativetok,
48
+ title={NativeTok: Native Visual Tokenization for Improved Image Generation},
49
+ author={Bin Wu and Mengqi Huang and Weinan Jia and Zhendong Mao},
50
+ journal={arXiv preprint arXiv:2601.22837},
51
+ year={2026}
52
+ }
53
+ ```