vuongminhkhoi4 commited on
Commit
5f6e454
Β·
verified Β·
1 Parent(s): 221718d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +130 -3
README.md CHANGED
@@ -1,3 +1,130 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+
6
+ # πŸš€ ComfyUI_InfiniteYou
7
+ An implementation of **InfiniteYou** for **ComfyUI**
8
+
9
+ Native support for [InfiniteYou](https://github.com/bytedance/InfiniteYou) in [ComfyUI](https://github.com/comfyanonymous/ComfyUI), designed by the ZenAI team.
10
+
11
+
12
+ **✨ Support further development by starring the project! ✨**
13
+
14
+
15
+ ![teaser](https://github.com/ZenAI-Comfy/ComfyUI_InfiniteYou/blob/main/assets/teaser.jpg)
16
+
17
+ ---
18
+
19
+ ## πŸ”₯ News
20
+ - **[03/2025]** πŸ”₯ Integrate Face Combine feature to predict future children
21
+ - **[03/2025]** πŸ”₯ Code updated and released as the first version.
22
+
23
+ ---
24
+
25
+ ## πŸ“œ Introduction
26
+
27
+ πŸš€ **InfiniteYou** is a **SOTA zero-shot identity preservation** model by **ByteDance**, built on **FLUX**. This repo brings it to **ComfyUI**, powered by **ZenAI**.
28
+
29
+ πŸ”— **References:**
30
+ πŸ“„ [Paper](https://arxiv.org/abs/2503.16418) | πŸ’Ύ [Official Repo](https://github.com/bytedance/InfiniteYou)
31
+
32
+ πŸ’‘ Inspired by **ZenID** πŸ”— [ZenID Repo](https://github.com/vuongminh1907/ComfyUI_ZenID)
33
+
34
+ πŸ”₯ Stay tuned for updates!
35
+
36
+ ---
37
+
38
+ ## πŸ† Model Zoo
39
+
40
+ The main author has released two versions of the model, each tailored for a specific purpose:
41
+
42
+ - πŸ”Ή **sim_stage1** – Prioritizes **higher identity similarity** for more accurate face preservation.
43
+ - 🎨 **aes_stage2** – Focuses on **better text-image alignment** and enhanced **aesthetics**.
44
+
45
+ To ensure seamless integration with **ComfyUI**, we have converted the model to the **safetensors** format.
46
+
47
+
48
+ **Download the model on Hugging Face:**
49
+ πŸ‘‰ [ComfyUI_InfiniteYou](https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou)
50
+ ---
51
+
52
+ ## πŸ› οΈ Workflow
53
+ ### **Zero-Shot Task**
54
+ ![Musk](https://github.com/ZenAI-Comfy/ComfyUI_InfiniteYou/blob/main/assets/musk.png)
55
+
56
+ ### **FaceCombine Task**
57
+ ![Children](https://github.com/ZenAI-Comfy/ComfyUI_InfiniteYou/blob/main/assets/face_combine_workflow.png)
58
+ ---
59
+
60
+ ## πŸ“¦ Installation
61
+
62
+ ### Step 1: Clone the Repo
63
+ ```bash
64
+ cd custom_nodes
65
+ git clone https://github.com/ZenAI-Comfy/ComfyUI_InfiniteYou
66
+ ```
67
+ ### Step 2: Install Requirements
68
+ ```bash
69
+ cd ComfyUI_InfiniteYou
70
+ pip install -r requirements.txt
71
+ ```
72
+
73
+ ### Step 3: Download ControlNet Models
74
+ ```bash
75
+ cd ../../models/controlnet
76
+ wget https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/aes_stage2_control_net/aes_stage2_control.safetensors
77
+ wget https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/sim_stage1_control_net/sim_stage1_control_net.safetensors
78
+ cd ..
79
+ ```
80
+ ### Step 4: Download Image Projection Files
81
+ ```bash
82
+ mkdir InfiniteYou
83
+ cd InfiniteYou
84
+ wget https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/aes_stage2_control_net/aes_stage2_img_proj.bin
85
+ wget https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/sim_stage1_control_net/sim_stage1_img_proj.bin
86
+ cd ../..
87
+ ```
88
+ ### Step 5: Download InsightFace model
89
+ The InsightFace model is **antelopev2** (not the classic buffalo_l). Download the models (for example from [here](https://drive.google.com/file/d/18wEUfMNohBJ4K3Ly5wpTejPfDzp-8fI8/view?usp=sharing) or [here](https://huggingface.co/MonsterMMORPG/tools/tree/main)), unzip and place them in the `ComfyUI/models/insightface/models/antelopev2` directory.
90
+
91
+ Alternatively, you can quickly download all **models** using the following command:
92
+ ```
93
+ # make sure you are in the ComfyUI directory
94
+ cd custom_nodes/
95
+ git clone https://github.com/ZenAI-Vietnam/ComfyUI_InfiniteYou
96
+ python ComfyUI_InfiniteYou/downloadmodel.py
97
+ pip install -r ComfyUI_InfiniteYou/requirements.txt
98
+ ```
99
+
100
+ ## 🧭 Usage
101
+
102
+ πŸ”Ή For `aes_stage2`: Try file `aes_stages2.json` in `workflows`
103
+
104
+ πŸ”Ή For `sim_stage1`: Try file `sim_stages1.json` in `workflows`
105
+
106
+ Predict your future children
107
+ πŸ”Ή For `Face Combine`: Try file `face_combine.json` in `workflows`
108
+
109
+
110
+
111
+ ## πŸ“ž Contact for Work 🌟
112
+ This implementation of InfiniteYou is brought to you by the ZenAI Team.
113
+
114
+ <img src="https://github.com/vuongminh1907/ComfyUI_ZenID/blob/main/examples/zenai.png" width="400" />
115
+
116
+ If you need more polished and enhanced version, please contact us through:
117
+ - πŸ“± **Facebook Page**: [ZenAI](https://web.facebook.com/zenai.vn)
118
+ - ☎️ **Phone**: 0971912713 Miss. Chi
119
+
120
+ ## πŸ“– Citation
121
+
122
+ ```bibtex
123
+ @article{jiang2025infiniteyou,
124
+ title={{InfiniteYou}: Flexible Photo Recrafting While Preserving Your Identity},
125
+ author={Jiang, Liming and Yan, Qing and Jia, Yumin and Liu, Zichuan and Kang, Hao and Lu, Xin},
126
+ journal={arXiv preprint},
127
+ volume={arXiv:2503.16418},
128
+ year={2025}
129
+ }
130
+ ```