Image-to-Image
Diffusers
Anyou commited on
Commit
46ad40f
·
verified ·
1 Parent(s): d0b267f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -1,3 +1,20 @@
1
  ---
2
  license: mit
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ base_model:
4
+ - black-forest-labs/FLUX.1-Kontext-dev
5
+ pipeline_tag: image-to-image
6
+ library_name: diffusers
7
  ---
8
+ # MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer
9
+
10
+ This repository contains the model and code for **MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer**, as presented in the paper:
11
+
12
+
13
+ ## Abstract
14
+
15
+ Makeup-transfer applies the reference makeup to the source face while preserving the source identity. Despite advances in full-face editing by diffusion-based methods, strong regional controllability, makeup fidelity, and identity preservation remain challenging. The reasons are (i) pixel-to-attention misalignment that causes spillover into non-target areas and weakens regional control; (ii) unclear transfer/preservation concept separation under two-image conditioning, leading to coupling between makeup attributes and identity; and (iii) the lack of a high-resolution dataset that is identity-consistent and region-labeled for fine-grained supervision. In this paper, we propose MagicMakeup, a diffusion transformer-based framework for region-controllable and high-fidelity makeup transfer, built on spatial constraints and concept disentanglement. To enable precise region-specific editing while preserving identity, we propose Token-Aligned Region Gating, which aligns pixel masks with attention and applies region-specific logit gating. To clarify the concepts of transfer and preservation, we further introduce Cross-Modal Perception Guidance, which aligns text and image features to enhance cross-modal concept perception. We also design a pipeline for the generation of 1024 x 1024 data pairs through region-specific makeup removal and establish a unified benchmark in synthetic and real settings. Extensive quantitative and qualitative experiments show that MagicMakeup improves regional controllability, makeup fidelity, and identity preservation, with strong robustness across styles, races, and poses.
16
+
17
+ ## Code and Usage
18
+
19
+ The official code and model are available at the following GitHub repository:
20
+ [https://github.com/vivoCameraResearch/Magic-Makeup](https://github.com/vivoCameraResearch/Magic-Makeup)