pangly commited on
Commit
a1fb2b5
·
verified ·
1 Parent(s): ec64773

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/teaser.jpg filter=lfs diff=lfs merge=lfs -text
37
+ assets/uniid.jpg filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,61 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ library_name: diffusers
4
+ tags:
5
+ - diffusers
6
+ - stable-diffusion
7
+ - text-to-image
8
+ - face-personalization
9
+ - tuning-free
10
+ - adapter
11
+ - uniid
12
  ---
13
+
14
+ UniID: Training for Identity, Inference for Controllability
15
+ Official model weights for “Training for Identity, Inference for Controllability: A Unified Approach to Tuning-Free Face Personalization”.
16
+
17
+ <a href="https://arxiv.org/abs/2512.03964"><img src="https://img.shields.io/badge/arXiv-2512.03964-b31b1b.svg"></a>
18
+ <a href="https://github.com/lyuPang/UniID"><img src="https://img.shields.io/badge/Github-Code-blue"></a>
19
+
20
+ ![teaser](assets/teaser.jpg)
21
+
22
+ ## Model Description
23
+ UniID is a unified tuning-free framework for face personalization that synergistically combines text embedding and adapter approaches. It is designed to achieve high identity fidelity while preserving the text controllability of the original diffusion model.
24
+
25
+ The key innovation lies in a strategic training-inference paradigm:
26
+
27
+ Training: An identity-focused learning scheme guides both the text embedding and adapter branches to capture exclusively identity-relevant features.
28
+
29
+ Inference: A normalized rescaling strategy recovers the text controllability of the original diffusion model and allows the identity signals from both branches to mutually reinforce each other.
30
+
31
+ This model repository contains the pre-trained weights for both the text_branch and the adapter_branch.
32
+
33
+ ![uniid](assets/uniid.jpg)
34
+
35
+ ## Model Architecture
36
+ UniID consists of two main components that work together:
37
+
38
+ Text Branch: Modifies the text embedding space to incorporate the target identity.
39
+
40
+ Adapter Branch: Uses an adapter (similar to IP-Adapter) to inject identity features from a reference image into the diffusion model.
41
+
42
+ For inference, both branches must be loaded and used simultaneously.
43
+
44
+
45
+ ## More Information
46
+
47
+ For the full inference and training code, detailed documentation, and more examples, please visit our GitHub repository:
48
+
49
+ **[🔗 GitHub Repository: UniID](https://github.com/lyuPang/UniID)**
50
+
51
+ ## Citation
52
+
53
+ If you use this model, please cite our work:
54
+ ```bibtex
55
+ @article{UniID,
56
+ title = {Training for Identity, Inference for Controllability: A Unified Approach to Tuning-Free Face Personalization},
57
+ author = {Lianyu Pang, Ji Zhou, Qiping Wang, Baoquan Zhao, Zhenguo Yang, Qing Li, Xudong Mao},
58
+ journal = {arXiv preprint arXiv:2512.03964},
59
+ year = {2025}
60
+ }
61
+ ```
assets/teaser.jpg ADDED

Git LFS Details

  • SHA256: 8470870ac59e78737676b3c028a6caad2357ad9c4c13f640e27aa13a55024f5f
  • Pointer size: 131 Bytes
  • Size of remote file: 709 kB
assets/uniid.jpg ADDED

Git LFS Details

  • SHA256: 8c8accb51e81121a4bde660821eb8a38ad2af2aa14934f90e83fa9aad48a314a
  • Pointer size: 132 Bytes
  • Size of remote file: 1.66 MB
ipa_branch/pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b55dd47a073e6366fa909544e25f5a94c01b8d39a2f75e3fab3d67d1f0309291
3
+ size 1599261282
text_branch/pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e32441b621a8f4fdf66435c33ed48f9b403027bac6b489da49f2cd1b5a5d666
3
+ size 470602330