UmiSonoda16 commited on
Commit
43dccd2
Β·
verified Β·
1 Parent(s): bb8bc8b

Add files using upload-large-folder tool

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/visual.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,76 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ tags:
5
+ - image-generation
6
+ - class-conditional
7
+ - diffusion
8
+ - mixture-of-experts
9
+ - pytorch
10
  ---
11
+
12
+ # PixelMoE: Scaling Pixel-Space Diffusion with LLM-Style Mixture-of-Experts
13
+
14
+ <div align="center">
15
+
16
+ [![arXiv](https://img.shields.io/badge/arXiv-2610.18857-b31b1b.svg)](https://arxiv.org/abs/2610.18857)&nbsp;
17
+ [![Hugging Face](https://img.shields.io/badge/HuggingFace-PixelMoE-yellow)](https://huggingface.co/KlingTeam/PixelMoE)&nbsp;
18
+
19
+ </div>
20
+
21
+ ![Images generated by PixelMoE](assets/visual.png)
22
+
23
+ ## πŸ“– Introduction
24
+
25
+ **PixelMoE** brings standard LLM-style Mixture-of-Experts (MoE) to pixel-space diffusion for class-conditional ImageNet generation at **256Γ—256** and **512Γ—512** resolution. Each image token activates **4 of 32 routed experts**, alongside a shared expert, with bias-based load balancing. Pixel-Space Hierarchical Flow Matching generates images in two stages, first establishing the overall structure at low resolution, then refining details at the target resolution.
26
+
27
+ PixelMoE achieves FID **1.47** at 256Γ—256 and **1.53** at 512Γ—512 on class-conditional ImageNet-1K, without representation alignment or perceptual losses.
28
+
29
+ ## πŸ“¦ Checkpoints
30
+
31
+ | Model | 256Γ—256 | FID ↓ | 512Γ—512 | FID ↓ |
32
+ |---|---|---|---|---|
33
+ | PixelMoE-B-E32A4 | [Download](https://huggingface.co/KlingTeam/PixelMoE/resolve/main/pixelmoe_b_e32a4_256.pth) | 1.88 | [Download](https://huggingface.co/KlingTeam/PixelMoE/resolve/main/pixelmoe_b_e32a4_512.pth) | 2.05 |
34
+ | PixelMoE-L-E32A4 | [Download](https://huggingface.co/KlingTeam/PixelMoE/resolve/main/pixelmoe_l_e32a4_256.pth) | 1.54 | [Download](https://huggingface.co/KlingTeam/PixelMoE/resolve/main/pixelmoe_l_e32a4_512.pth) | 1.58 |
35
+ | PixelMoE-H-E32A4 | [Download](https://huggingface.co/KlingTeam/PixelMoE/resolve/main/pixelmoe_h_e32a4_256.pth) | **1.47** | [Download](https://huggingface.co/KlingTeam/PixelMoE/resolve/main/pixelmoe_h_e32a4_512.pth) | **1.53** |
36
+
37
+ FID scores are the ImageNet-1K results reported in the paper. B, L, and H denote Base, Large, and Huge; E32A4 denotes 32 routed experts with 4 activated per token.
38
+
39
+ ## πŸš€ Download Models
40
+
41
+ Download a checkpoint with the [Hugging Face CLI](https://huggingface.co/docs/huggingface_hub/guides/cli):
42
+
43
+ ```bash
44
+ pip install -U huggingface_hub
45
+ hf download KlingTeam/PixelMoE pixelmoe_h_e32a4_256.pth --local-dir checkpoints
46
+ ```
47
+
48
+ To download the entire model repository instead:
49
+
50
+ ```bash
51
+ hf download KlingTeam/PixelMoE --local-dir checkpoints
52
+ ```
53
+
54
+ ## πŸ“Œ Note
55
+
56
+ This repository hosts the pretrained checkpoints of **PixelMoE**.
57
+
58
+ ## πŸ“– Citation
59
+
60
+ If you find PixelMoE useful in your research, please cite our paper:
61
+
62
+ ```bibtex
63
+ @misc{dong2026pixelmoescalingpixelspacediffusion,
64
+ title={PixelMoE: Scaling Pixel-Space Diffusion with LLM-Style Mixture-of-Experts},
65
+ author={Ruixiao Dong and Jianmin Bao and Bozhi Luan and Zijie Meng and Xin Tao and Pengfei Wan and Kun Gai and Li Li and Houqiang Li},
66
+ year={2026},
67
+ eprint={2610.18857},
68
+ archivePrefix={arXiv},
69
+ primaryClass={cs.CV},
70
+ url={https://arxiv.org/abs/2610.18857},
71
+ }
72
+ ```
73
+
74
+ ## Contact
75
+
76
+ For questions, please contact [dongruixiao@kuaishou.com](mailto:dongruixiao@kuaishou.com).
assets/visual.png ADDED

Git LFS Details

  • SHA256: 52092a0f255b68bd8617b66ae1ab35fdc60b11abd6286d20ba88e7cda23b35a9
  • Pointer size: 133 Bytes
  • Size of remote file: 12.6 MB
pixelmoe_b_e32a4_256.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1193ba792815af384077d2a622634ac85d280f5a5648a923540ee26ef1b30bf8
3
+ size 5545764179
pixelmoe_b_e32a4_512.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa035667a1584830921faa3712f580a79969224171b1bcfc0fff792a9f50b412
3
+ size 5567889567
pixelmoe_h_e32a4_256.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a070f6917775a3beceee56ee4093574cc82f49afe187cbc7f7767c5beb8ed9ff
3
+ size 44185392307
pixelmoe_h_e32a4_512.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cd9687f3f9571d1a79e9a92ab6e154e86f8b95568fbbd6117808dff63db3ca3
3
+ size 44222558195
pixelmoe_l_e32a4_256.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32b8441c927dfb1611160db190c5c43dbe7b26f5a43619b54f0ac81e58af3b9e
3
+ size 19780414227
pixelmoe_l_e32a4_512.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4d59c65df623a0a95b9ef944c48c59eee7f62977f0d25f67c231fafed290ed6
3
+ size 19809617427