Update model card with paper links and improved metadata
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,7 +1,12 @@
|
|
| 1 |
---
|
| 2 |
-
license: cc-by-nc-4.0
|
| 3 |
-
pipeline_tag: video-to-video
|
| 4 |
library_name: diffusers
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
---
|
| 6 |
|
| 7 |
<div align="center">
|
|
@@ -23,27 +28,27 @@ library_name: diffusers
|
|
| 23 |
</p>
|
| 24 |
<p>
|
| 25 |
<a href="https://henghuiding.com/EffectErase/" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/🐳-Project%20Page-blue" alt="Project Page" /></a>
|
| 26 |
-
<a href="https://
|
| 27 |
<a href="https://github.com/FudanCVL/EffectErase" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/GitHub-FudanCVL%2FEffectErase-181717?logo=github" alt="GitHub" /></a>
|
| 28 |
-
<a href="
|
| 29 |
<a href="https://huggingface.co/datasets/FudanCVL/EffectErase" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Dataset-Hugging%20Face-yellow" alt="Dataset" /></a>
|
| 30 |
</p>
|
| 31 |
</div>
|
| 32 |
|
| 33 |
-
This repository provides the checkpoint `EffectErase.ckpt` for **EffectErase**.
|
| 34 |
|
| 35 |
<img src="assets/teaser.gif" alt="teaser" />
|
| 36 |
|
| 37 |
## Abstract
|
| 38 |
|
| 39 |
-
Video object removal aims to eliminate dynamic target objects and their visual effects, such as deformation, shadows, and reflections, while restoring seamless backgrounds.
|
| 40 |
|
| 41 |
## Quick Start
|
| 42 |
|
| 43 |
1. Setup repository and environment
|
| 44 |
|
| 45 |
```bash
|
| 46 |
-
git clone
|
| 47 |
cd EffectErase
|
| 48 |
pip install -e .
|
| 49 |
```
|
|
@@ -61,18 +66,13 @@ Video object removal aims to eliminate dynamic target objects and their visual e
|
|
| 61 |
bash script/test_remove.sh
|
| 62 |
```
|
| 63 |
|
| 64 |
-
You can edit `script/test_remove.sh` and change these
|
| 65 |
-
|
| 66 |
-
- `--
|
| 67 |
-
- `--
|
| 68 |
-
- `--output_path`
|
| 69 |
-
|
| 70 |
-
`--mask_path` is a mask video generated by SAM2.1 (`sam2.1_hiera_b+`), aligned with `--fg_bg_path`.
|
| 71 |
|
| 72 |
## BibTeX
|
| 73 |
|
| 74 |
-
Please consider to cite:
|
| 75 |
-
|
| 76 |
```bibtex
|
| 77 |
@inproceedings{fu2026effecterase,
|
| 78 |
title={EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing},
|
|
@@ -84,5 +84,4 @@ Please consider to cite:
|
|
| 84 |
|
| 85 |
## Contact
|
| 86 |
|
| 87 |
-
If you have any questions, please feel free to reach
|
| 88 |
-
|
|
|
|
| 1 |
---
|
|
|
|
|
|
|
| 2 |
library_name: diffusers
|
| 3 |
+
license: cc-by-nc-4.0
|
| 4 |
+
pipeline_tag: image-to-image
|
| 5 |
+
tags:
|
| 6 |
+
- video-to-video
|
| 7 |
+
- video-object-removal
|
| 8 |
+
- video-inpainting
|
| 9 |
+
- cvpr
|
| 10 |
---
|
| 11 |
|
| 12 |
<div align="center">
|
|
|
|
| 28 |
</p>
|
| 29 |
<p>
|
| 30 |
<a href="https://henghuiding.com/EffectErase/" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/🐳-Project%20Page-blue" alt="Project Page" /></a>
|
| 31 |
+
<a href="https://huggingface.co/papers/2603.19224" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/Paper-CVPR%202026-green" alt="Paper" /></a>
|
| 32 |
<a href="https://github.com/FudanCVL/EffectErase" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/GitHub-FudanCVL%2FEffectErase-181717?logo=github" alt="GitHub" /></a>
|
| 33 |
+
<a href="https://huggingface.co/papers/2603.19224" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/arXiv-2603.19224-red" alt="arXiv" /></a>
|
| 34 |
<a href="https://huggingface.co/datasets/FudanCVL/EffectErase" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Dataset-Hugging%20Face-yellow" alt="Dataset" /></a>
|
| 35 |
</p>
|
| 36 |
</div>
|
| 37 |
|
| 38 |
+
This repository provides the checkpoint `EffectErase.ckpt` for **EffectErase**, as presented in the paper [EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing](https://huggingface.co/papers/2603.19224).
|
| 39 |
|
| 40 |
<img src="assets/teaser.gif" alt="teaser" />
|
| 41 |
|
| 42 |
## Abstract
|
| 43 |
|
| 44 |
+
Video object removal aims to eliminate dynamic target objects and their visual effects, such as deformation, shadows, and reflections, while restoring seamless backgrounds. Current methods often struggle to erase these effects and synthesize coherent backgrounds. To address this, we introduce **VOR** (**V**ideo **O**bject **R**emoval), a large-scale dataset of 60K high-quality video pairs covering various object effects. Building on VOR, we propose ***EffectErase***, an effect-aware video object removal method that treats video object insertion as a reciprocal learning task. The model includes task-aware region guidance and an insertion-removal consistency objective to ensure high-quality video object effect erasing across diverse scenarios.
|
| 45 |
|
| 46 |
## Quick Start
|
| 47 |
|
| 48 |
1. Setup repository and environment
|
| 49 |
|
| 50 |
```bash
|
| 51 |
+
git clone https://github.com/FudanCVL/EffectErase.git
|
| 52 |
cd EffectErase
|
| 53 |
pip install -e .
|
| 54 |
```
|
|
|
|
| 66 |
bash script/test_remove.sh
|
| 67 |
```
|
| 68 |
|
| 69 |
+
You can edit `script/test_remove.sh` and change these paths to use your own data:
|
| 70 |
+
- `--fg_bg_path`: Path to the input video.
|
| 71 |
+
- `--mask_path`: Path to the mask video (e.g., generated by SAM2.1).
|
| 72 |
+
- `--output_path`: Path for the saved results.
|
|
|
|
|
|
|
|
|
|
| 73 |
|
| 74 |
## BibTeX
|
| 75 |
|
|
|
|
|
|
|
| 76 |
```bibtex
|
| 77 |
@inproceedings{fu2026effecterase,
|
| 78 |
title={EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing},
|
|
|
|
| 84 |
|
| 85 |
## Contact
|
| 86 |
|
| 87 |
+
If you have any questions, please feel free to reach out at aleeyanger@gmail.com.
|
|
|