|
|
|
|
|
|
|
|
| --- |
| title: ROSE |
| emoji: 🚀 |
| colorFrom: blue |
| colorTo: pink |
| sdk: gradio |
| sdk_version: 5.35.0 |
| short_description: 'ROSE: Remove Objects with Side Effects in Videos' |
| app_file: app.py |
| pinned: false |
| --- |
| |
| ## Get Started |
| 1. Install ROSE Dependencies |
|
|
| You can follow the [Dependencies and Installation](https://github.com/Kunbyte-AI/ROSE?tab=readme-ov-file#dependencies-and-installation). |
|
|
| 3. Install Demo Dependencies |
| ```shell |
| cd hugging_face/ |
| |
| # install python dependencies |
| pip3 install -r requirements.txt |
| |
| # Run the demo |
| python app.py |
| ``` |
|
|
| ## Usage Guidance |
| * Step 1: Upload your video and click the `Get video info` button. |
|
|
| * Step 2: |
| 1. *[Optional]* Specify the tracking period for the currently added mask by dragging the `Track start frame` or `Track end frame`. |
| 2. Click the image on the left to select the mask area. |
| 3. - Click `Add mask` if you are satisfied with the mask, or |
| - *[Optional]* Click `Clear clicks` if you want to reselect the mask area, or |
| - *[Optional]* Click `Remove mask` to remove all masks. |
| 4. *[Optional]* Go back to step 2.1 to add another mask. |
|
|
| |
| * Step 3: |
| 1. Click the `Tracking` button to track the masks for the whole video. |
| 2. Then click `Inpainting` to get the inpainting results. |
|
|
|
|
| *You can always refer to the `Highlighted Text` box on the page for guidance on the next step!* |
|
|
|
|
| ## Citation |
| If you find our repo useful for your research, please consider citing our paper: |
| ```bibtex |
| @article{miao2025rose, |
| title={ROSE: Remove Objects with Side Effects in Videos}, |
| author={Miao, Chenxuan and Feng, Yutong and Zeng, Jianshu and Gao, Zixiang and Liu, Hantang and Yan, Yunfeng and Qi, Donglian and Chen, Xi and Wang, Bin and Zhao, Hengshuang}, |
| journal={arXiv preprint arXiv:2508.18633}, |
| year={2025} |
| } |
| ``` |
|
|
|
|
|
|
| ## Acknowledgements |
|
|
| The project harnesses the capabilities from [Track Anything](https://github.com/gaomingqi/Track-Anything), [Segment Anything](https://github.com/facebookresearch/segment-anything) and [Cutie](https://github.com/hkchengrex/Cutie). Also the gradio demo page is based on [ProPainter's huggingface demo page](https://github.com/sczhou/ProPainter/tree/main/web-demos/hugging_face). Thanks for their awesome works. |
|
|
