Update model card with paper links and improved metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +17 -18
README.md CHANGED
@@ -1,7 +1,12 @@
1
  ---
2
- license: cc-by-nc-4.0
3
- pipeline_tag: video-to-video
4
  library_name: diffusers
 
 
 
 
 
 
 
5
  ---
6
 
7
  <div align="center">
@@ -23,27 +28,27 @@ library_name: diffusers
23
  </p>
24
  <p>
25
  <a href="https://henghuiding.com/EffectErase/" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/🐳-Project%20Page-blue" alt="Project Page" /></a>
26
- <a href="https://cvpr.thecvf.com/virtual/2026/papers.html" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/Paper-CVPR%202026-green" alt="Paper" /></a>
27
  <a href="https://github.com/FudanCVL/EffectErase" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/GitHub-FudanCVL%2FEffectErase-181717?logo=github" alt="GitHub" /></a>
28
- <a href="http://arxiv.org/" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/arXiv-EffectErase-red" alt="arXiv" /></a>
29
  <a href="https://huggingface.co/datasets/FudanCVL/EffectErase" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Dataset-Hugging%20Face-yellow" alt="Dataset" /></a>
30
  </p>
31
  </div>
32
 
33
- This repository provides the checkpoint `EffectErase.ckpt` for **EffectErase**.
34
 
35
  <img src="assets/teaser.gif" alt="teaser" />
36
 
37
  ## Abstract
38
 
39
- Video object removal aims to eliminate dynamic target objects and their visual effects, such as deformation, shadows, and reflections, while restoring seamless backgrounds. Recent diffusion-based video inpainting and object removal methods can remove the objects but often struggle to erase these effects and to synthesize coherent backgrounds. Beyond method limitations, progress is further hampered by the lack of a comprehensive dataset that systematically captures common object effects across varied environments for training and evaluation. To address this, we introduce **VOR** (**V**ideo **O**bject **R**emoval), a large-scale dataset that provides diverse paired videos, each consisting of one video where the target object is present with its effects and a counterpart where the object and effects are absent, with corresponding object masks. VOR contains 60k high-quality video pairs from captured and synthetic sources, covers five effects types, and spans a wide range of object categories as well as complex, dynamic multi-object scenes. Building on VOR, we propose ***EffectErase***, an effect-aware video object removal method that treats video object insertion as the inverse auxiliary task within a reciprocal learning scheme. The model includes task-aware region guidance that focuses learning on affected areas and enables flexible task switching. Then, an insertionremoval consistency objective that encourages complementary behaviors and shared localization of effect regions and structural cues. Trained on VOR, EffectErase achieves superior performance in extensive experiments, delivering high-quality video object effect erasing across diverse scenarios.
40
 
41
  ## Quick Start
42
 
43
  1. Setup repository and environment
44
 
45
  ```bash
46
- git clone git@github.com:FudanCVL/EffectErase.git
47
  cd EffectErase
48
  pip install -e .
49
  ```
@@ -61,18 +66,13 @@ Video object removal aims to eliminate dynamic target objects and their visual e
61
  bash script/test_remove.sh
62
  ```
63
 
64
- You can edit `script/test_remove.sh` and change these three paths to use your own data:
65
-
66
- - `--fg_bg_path`
67
- - `--mask_path`
68
- - `--output_path`
69
-
70
- `--mask_path` is a mask video generated by SAM2.1 (`sam2.1_hiera_b+`), aligned with `--fg_bg_path`.
71
 
72
  ## BibTeX
73
 
74
- Please consider to cite:
75
-
76
  ```bibtex
77
  @inproceedings{fu2026effecterase,
78
  title={EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing},
@@ -84,5 +84,4 @@ Please consider to cite:
84
 
85
  ## Contact
86
 
87
- If you have any questions, please feel free to reach me out at aleeyanger@gmail.com.
88
-
 
1
  ---
 
 
2
  library_name: diffusers
3
+ license: cc-by-nc-4.0
4
+ pipeline_tag: image-to-image
5
+ tags:
6
+ - video-to-video
7
+ - video-object-removal
8
+ - video-inpainting
9
+ - cvpr
10
  ---
11
 
12
  <div align="center">
 
28
  </p>
29
  <p>
30
  <a href="https://henghuiding.com/EffectErase/" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/🐳-Project%20Page-blue" alt="Project Page" /></a>
31
+ <a href="https://huggingface.co/papers/2603.19224" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/Paper-CVPR%202026-green" alt="Paper" /></a>
32
  <a href="https://github.com/FudanCVL/EffectErase" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/GitHub-FudanCVL%2FEffectErase-181717?logo=github" alt="GitHub" /></a>
33
+ <a href="https://huggingface.co/papers/2603.19224" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/arXiv-2603.19224-red" alt="arXiv" /></a>
34
  <a href="https://huggingface.co/datasets/FudanCVL/EffectErase" target="_blank" rel="noreferrer"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Dataset-Hugging%20Face-yellow" alt="Dataset" /></a>
35
  </p>
36
  </div>
37
 
38
+ This repository provides the checkpoint `EffectErase.ckpt` for **EffectErase**, as presented in the paper [EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing](https://huggingface.co/papers/2603.19224).
39
 
40
  <img src="assets/teaser.gif" alt="teaser" />
41
 
42
  ## Abstract
43
 
44
+ Video object removal aims to eliminate dynamic target objects and their visual effects, such as deformation, shadows, and reflections, while restoring seamless backgrounds. Current methods often struggle to erase these effects and synthesize coherent backgrounds. To address this, we introduce **VOR** (**V**ideo **O**bject **R**emoval), a large-scale dataset of 60K high-quality video pairs covering various object effects. Building on VOR, we propose ***EffectErase***, an effect-aware video object removal method that treats video object insertion as a reciprocal learning task. The model includes task-aware region guidance and an insertion-removal consistency objective to ensure high-quality video object effect erasing across diverse scenarios.
45
 
46
  ## Quick Start
47
 
48
  1. Setup repository and environment
49
 
50
  ```bash
51
+ git clone https://github.com/FudanCVL/EffectErase.git
52
  cd EffectErase
53
  pip install -e .
54
  ```
 
66
  bash script/test_remove.sh
67
  ```
68
 
69
+ You can edit `script/test_remove.sh` and change these paths to use your own data:
70
+ - `--fg_bg_path`: Path to the input video.
71
+ - `--mask_path`: Path to the mask video (e.g., generated by SAM2.1).
72
+ - `--output_path`: Path for the saved results.
 
 
 
73
 
74
  ## BibTeX
75
 
 
 
76
  ```bibtex
77
  @inproceedings{fu2026effecterase,
78
  title={EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing},
 
84
 
85
  ## Contact
86
 
87
+ If you have any questions, please feel free to reach out at aleeyanger@gmail.com.