QinmingZhou commited on
Commit
d5ad9cc
·
verified ·
1 Parent(s): 0533eec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +67 -0
README.md CHANGED
@@ -1,3 +1,70 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ library_name: diffusers
4
+ tags:
5
+ - object-removal
6
+ - image-inpainting
7
+ - diffusion
8
+ - lora
9
+ - osor
10
  ---
11
+
12
+ # OSOR
13
+
14
+ OSOR is a one-step diffusion framework for effect-aware object removal. It removes target objects together with associated effects such as shadows, reflections, and residual traces, while requiring only a single denoising step at inference.
15
+
16
+ Model page: https://huggingface.co/QinmingZhou/OSOR
17
+
18
+ ## Model Summary
19
+
20
+ OSOR is trained with a two-phase curriculum:
21
+
22
+ 1. **Phase I** trains one-step removal with hard latent blending and occupancy-guided discriminator supervision.
23
+ 2. **Phase II** adds alpha prediction and trains with incomplete-mask conditioning, enabling the model to expand the effective removal region beyond conservative user masks.
24
+
25
+ The code release includes two backbone implementations:
26
+
27
+ - OSOR-FLUX-Fill
28
+ - OSOR-SDXL-Inpainting
29
+
30
+ ## Release Status
31
+
32
+ The model repository contains checkpoints for both released OSOR backbones:
33
+
34
+ ```text
35
+ osor-fluxfill/weights/fluxfill_phase1.pth
36
+ osor-fluxfill/weights/fluxfill_phase2.pth
37
+ osor-sdxlinpainting/weights/sdxlinpainting_phase1.pth
38
+ osor-sdxlinpainting/weights/sdxlinpainting_phase2.pth
39
+ ```
40
+
41
+ Download with:
42
+
43
+ ```bash
44
+ hf download QinmingZhou/OSOR --include "osor-fluxfill/weights/*.pth" --local-dir .
45
+ hf download QinmingZhou/OSOR --include "osor-sdxlinpainting/weights/*.pth" --local-dir .
46
+ ```
47
+
48
+ ## Intended Use
49
+
50
+ OSOR is intended for research on object removal, image inpainting, and mask-conditioned image editing. Given an object-present image and a user-provided mask, OSOR predicts a clean background with object-associated effects removed.
51
+
52
+ ## Inputs And Outputs
53
+
54
+ Inputs:
55
+
56
+ - `image`: object-present input image.
57
+ - `mask`: binary or soft removal mask.
58
+
59
+ Outputs:
60
+
61
+ - `image`: object-removed image.
62
+ - Phase II implementations may also produce or internally use an alpha map for adaptive blending.
63
+
64
+ ## Training Data
65
+
66
+ OSOR is trained on CORNE, a SAVP-verified effect-aware object-removal dataset. Evaluation uses CORNE-Val, AnimeEraseBench, TextEraseBench, and additional paired-background object-removal benchmarks.
67
+
68
+ ## Limitations
69
+
70
+ OSOR may fail when the target object is extremely large, the mask is severely incorrect, or the background requires ambiguous semantic hallucination. As with other generative editing models, outputs should be reviewed before use in high-stakes contexts.