Improve model card: add paper link, authors, and teaser image

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +17 -6
README.md CHANGED
@@ -1,6 +1,8 @@
1
  ---
2
- license: mit
 
3
  library_name: diffusers
 
4
  pipeline_tag: image-to-image
5
  tags:
6
  - flux
@@ -11,17 +13,25 @@ tags:
11
  - depth
12
  - normal
13
  - lighting
14
- base_model:
15
- - black-forest-labs/FLUX.1-dev
16
  ---
17
 
18
  # DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformer
19
 
20
- These are the pre-trained **Shader LoRA weights** for [DealMaTe](https://github.com/haha-lisa/DealMaTe) — an efficient, text-free material transfer framework built on FLUX.1 Diffusion Transformer.
 
 
 
 
 
 
 
 
21
 
22
  Given a material reference image and a target object image, DealMaTe faithfully transfers the material appearance onto the object while preserving its 3D geometry, lighting, and surface structure.
23
 
24
- **Paper:** *ACM Transactions on Graphics (TOG), 2026*
 
 
25
 
26
  ## Model Weights
27
 
@@ -57,7 +67,8 @@ python inference.py \
57
  --normal_path examples/inputs/normal.png \
58
  --lighting_path examples/inputs/lighting.png \
59
  --output_path outputs/result.png \
60
- --lora_path ./lora
 
61
  ```
62
 
63
  **Required base models (auto-downloaded):**
 
1
  ---
2
+ base_model:
3
+ - black-forest-labs/FLUX.1-dev
4
  library_name: diffusers
5
+ license: mit
6
  pipeline_tag: image-to-image
7
  tags:
8
  - flux
 
13
  - depth
14
  - normal
15
  - lighting
 
 
16
  ---
17
 
18
  # DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformer
19
 
20
+ These are the pre-trained **Shader LoRA weights** for [DealMaTe](https://github.com/haha-lisa/DealMaTe) — an efficient, text-free material transfer framework built on the FLUX.1 Diffusion Transformer.
21
+
22
+ [**Paper**](https://huggingface.co/papers/2605.15681) | [**ArXiv**](https://arxiv.org/abs/2605.15681) | [**Code**](https://github.com/haha-lisa/DealMaTe)
23
+
24
+ **Authors:** Nisha Huang, Yizhou Lin, Jie Guo, Xiu Li, Tong-Yee Lee, Zitong Yu.
25
+
26
+ <p align="center">
27
+ <img src="https://raw.githubusercontent.com/haha-lisa/DealMaTe/main/assets/teaser.jpg" alt="DealMaTe teaser" width="900"/>
28
+ </p>
29
 
30
  Given a material reference image and a target object image, DealMaTe faithfully transfers the material appearance onto the object while preserving its 3D geometry, lighting, and surface structure.
31
 
32
+ ## Overview
33
+
34
+ DealMaTe is a simplified diffusion framework that eliminates text dependency and reference networks by using depth, normal, and lighting images for material transfer. It utilizes a lightweight 3D information injection method, **Multi-Dim 3D Shader LoRA**, which enables compatible control conditions and achieves harmonious results without modifying base model weights.
35
 
36
  ## Model Weights
37
 
 
67
  --normal_path examples/inputs/normal.png \
68
  --lighting_path examples/inputs/lighting.png \
69
  --output_path outputs/result.png \
70
+ --lora_path ./lora \
71
+ --seed 42
72
  ```
73
 
74
  **Required base models (auto-downloaded):**