Instructions to use QinmingZhou/OSOR with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use QinmingZhou/OSOR with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("fill-in-base-model", torch_dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("QinmingZhou/OSOR") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - PEFT
How to use QinmingZhou/OSOR with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,70 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
tags:
|
| 5 |
+
- object-removal
|
| 6 |
+
- image-inpainting
|
| 7 |
+
- diffusion
|
| 8 |
+
- lora
|
| 9 |
+
- osor
|
| 10 |
---
|
| 11 |
+
|
| 12 |
+
# OSOR
|
| 13 |
+
|
| 14 |
+
OSOR is a one-step diffusion framework for effect-aware object removal. It removes target objects together with associated effects such as shadows, reflections, and residual traces, while requiring only a single denoising step at inference.
|
| 15 |
+
|
| 16 |
+
Model page: https://huggingface.co/QinmingZhou/OSOR
|
| 17 |
+
|
| 18 |
+
## Model Summary
|
| 19 |
+
|
| 20 |
+
OSOR is trained with a two-phase curriculum:
|
| 21 |
+
|
| 22 |
+
1. **Phase I** trains one-step removal with hard latent blending and occupancy-guided discriminator supervision.
|
| 23 |
+
2. **Phase II** adds alpha prediction and trains with incomplete-mask conditioning, enabling the model to expand the effective removal region beyond conservative user masks.
|
| 24 |
+
|
| 25 |
+
The code release includes two backbone implementations:
|
| 26 |
+
|
| 27 |
+
- OSOR-FLUX-Fill
|
| 28 |
+
- OSOR-SDXL-Inpainting
|
| 29 |
+
|
| 30 |
+
## Release Status
|
| 31 |
+
|
| 32 |
+
The model repository contains checkpoints for both released OSOR backbones:
|
| 33 |
+
|
| 34 |
+
```text
|
| 35 |
+
osor-fluxfill/weights/fluxfill_phase1.pth
|
| 36 |
+
osor-fluxfill/weights/fluxfill_phase2.pth
|
| 37 |
+
osor-sdxlinpainting/weights/sdxlinpainting_phase1.pth
|
| 38 |
+
osor-sdxlinpainting/weights/sdxlinpainting_phase2.pth
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
Download with:
|
| 42 |
+
|
| 43 |
+
```bash
|
| 44 |
+
hf download QinmingZhou/OSOR --include "osor-fluxfill/weights/*.pth" --local-dir .
|
| 45 |
+
hf download QinmingZhou/OSOR --include "osor-sdxlinpainting/weights/*.pth" --local-dir .
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
## Intended Use
|
| 49 |
+
|
| 50 |
+
OSOR is intended for research on object removal, image inpainting, and mask-conditioned image editing. Given an object-present image and a user-provided mask, OSOR predicts a clean background with object-associated effects removed.
|
| 51 |
+
|
| 52 |
+
## Inputs And Outputs
|
| 53 |
+
|
| 54 |
+
Inputs:
|
| 55 |
+
|
| 56 |
+
- `image`: object-present input image.
|
| 57 |
+
- `mask`: binary or soft removal mask.
|
| 58 |
+
|
| 59 |
+
Outputs:
|
| 60 |
+
|
| 61 |
+
- `image`: object-removed image.
|
| 62 |
+
- Phase II implementations may also produce or internally use an alpha map for adaptive blending.
|
| 63 |
+
|
| 64 |
+
## Training Data
|
| 65 |
+
|
| 66 |
+
OSOR is trained on CORNE, a SAVP-verified effect-aware object-removal dataset. Evaluation uses CORNE-Val, AnimeEraseBench, TextEraseBench, and additional paired-background object-removal benchmarks.
|
| 67 |
+
|
| 68 |
+
## Limitations
|
| 69 |
+
|
| 70 |
+
OSOR may fail when the target object is extremely large, the mask is severely incorrect, or the background requires ambiguous semantic hallucination. As with other generative editing models, outputs should be reviewed before use in high-stakes contexts.
|