Spaces:

XiangpengYang
/

VideoGrain

Configuration error

App Files Files Community

XiangpengYang commited on Mar 3, 2025

Commit

2d104cb

1 Parent(s): 9d88495

part demo

Browse files

Files changed (31) hide show

README.md +52 -13
assets/{teaser → instance-level}/2cars.gif +0 -0
assets/{teaser → instance-level}/badminton.gif +0 -0
assets/{teaser → instance-level}/bike_3.gif +0 -0
assets/{teaser → instance-level}/left_iron_right_spider.gif +0 -0
assets/{teaser → instance-level}/panda_vs_poddle.gif +0 -0
assets/{teaser → instance-level}/teddy_koala.gif +0 -0
assets/part-level/black-suit.gif +3 -0
assets/part-level/blue-shirt.gif +3 -0
assets/part-level/cat_flower.gif +3 -0
assets/part-level/ginger_body.gif +3 -0
assets/part-level/ginger_head.gif +3 -0
assets/part-level/man_text_message.gif +3 -0
assets/part-level/superman_cap.gif +3 -0
assets/part-level/superman_sunglass.gif +3 -0
assets/part-level/thor_sunglass.gif +3 -0
config/class_level/running_two_man/{running_man2spider.yaml → man2spider.yaml} +0 -0
config/instance_level/2_cars/{2cars_left_firetruck_right_school_bus.yaml → left_firetruck_right_bus.yaml} +0 -0
config/instance_level/2_cars/{2cars_left_firetruck_right_school_bus_preserve_bg.yaml → left_firetruck_right_school_bus_preserve_bg.yaml} +0 -0
config/instance_level/2_cats/{2cats_3cls_samoyed_vs_tiger_sunrise.yaml → 3cls_samoyed_vs_tiger_sunrise.yaml} +0 -0
config/instance_level/2_cats/{2cats_4cls_panda_vs_poddle.yaml → 4cls_panda_vs_poddle.yaml} +0 -0
config/instance_level/2_monkeys/{monkeys_2cls_teddy_bear_golden_retriever.yaml → 2cls_teddy_bear_golden_retriever.yaml} +0 -0
config/instance_level/2_monkeys/{monkeys_2cls_teddy_bear_koala.yaml → 2cls_teddy_bear_koala.yaml} +0 -0
config/instance_level/badminton/{badminton_2cls_wonder_woman_spiderman.yaml → 2cls_wonder_woman_spiderman.yaml} +0 -0
config/instance_level/running_two_man/{running_3cls_iron_spider.yaml → 3cls_iron_spider.yaml} +0 -0
config/instance_level/running_two_man/{running_3cls_polar_spider_vis_weight.yaml → 3cls_spider_polar_vis_weight.yaml} +0 -0
config/instance_level/running_two_man/{running_4cls_spider_polar.yaml → 4cls_spider_polar.yaml} +0 -0
config/part_level/{part_level_modification → modification}/cat_flower/ginger_body.yaml +0 -0
config/part_level/{part_level_modification → modification}/cat_flower/ginger_head.yaml +0 -0
config/part_level/{part_level_modification → modification}/man_text_message/black_suit.yaml +0 -0
config/part_level/{part_level_modification → modification}/man_text_message/blue_shirt.yaml +0 -0

README.md CHANGED Viewed

@@ -155,9 +155,9 @@ result
 ### 🌈 Multi-Grained Definition
 You can get multi-grained definition result, using the following command:
 ```bash
-CUDA_VISIBLE_DEVICES=0 accelerate launch test.py --config /config/class_level/running_two_man/running_man2spider.yaml   #class-level
-                                                # /config/instance_level/running_two_man/running_4cls_spider_polar.yaml  #instance-level
-                                      #config/part_level/adding_new_object/run_two_man/running_spider_polar_sunglass.yaml #part-level
 ```
 <table class="center">
 <tr>
@@ -174,10 +174,10 @@ CUDA_VISIBLE_DEVICES=0 accelerate launch test.py --config /config/class_level/ru
 </tr>
 </table>
-## 💃 Instance-level Video Editing
-You can get instance-level video editing results, using the following command:
 ```bash
-CUDA_VISIBLE_DEVICES=0 accelerate launch test.py --config  config/instance_level/running_two_man/running_3cls_iron_spider.yaml
 ```
 <table class="center">
@@ -186,25 +186,64 @@ CUDA_VISIBLE_DEVICES=0 accelerate launch test.py --config  config/instance_level
   <td width=50% style="text-align:center;">2_monkeys/2cls_teddy_bear_koala.yaml</td>
 </tr>
 <tr>
-  <td><img src="assets/teaser/left_iron_right_spider.gif"></td>
-  <td><img src="assets/teaser/teddy_koala.gif"></td>
 </tr>
 <tr>
   <td width=50% style="text-align:center;">badminton/2cls_wonder_woman_spiderman.yaml</td>
-  <td width=50% style="text-align:center;">bike_3/left_ironman_right_monkey.yaml</td>
 </tr>
 <tr>
-  <td><img src="assets/teaser/badminton.gif"></td>
-  <td><img src="assets/teaser/bike_3.gif"></td>
 </tr>
 <tr>
   <td width=50% style="text-align:center;">2_cats/4cls_panda_vs_poddle.yaml</td>
   <td width=50% style="text-align:center;">2_cars/left_firetruck_right_bus.yaml</td>
 </tr>
 <tr>
-  <td><img src="assets/teaser/panda_vs_poddle.gif"></td>
-  <td><img src="assets/teaser/2cars.gif"></td>
 </tr>
 </table>

 ### 🌈 Multi-Grained Definition
 You can get multi-grained definition result, using the following command:
 ```bash
+CUDA_VISIBLE_DEVICES=0 accelerate launch test.py --config /config/class_level/running_two_man/man2spider.yaml   #class-level
+                                                # /config/instance_level/running_two_man/4cls_spider_polar.yaml  #instance-level
+                                      #config/part_level/adding_new_object/run_two_man/spider_polar_sunglass.yaml #part-level
 ```
 <table class="center">
 <tr>
 </tr>
 </table>
+## 🕺  Part-level Video Editing
+You can get part-level video editing results, using the following command:
 ```bash
+CUDA_VISIBLE_DEVICES=0 accelerate launch test.py --config config/part_level/modification/man_text_message/blue_shirt.yaml
 ```
 <table class="center">
   <td width=50% style="text-align:center;">2_monkeys/2cls_teddy_bear_koala.yaml</td>
 </tr>
 <tr>
+  <td><img src="assets/instance-level/left_iron_right_spider.gif"></td>
+  <td><img src="assets/instance-level/teddy_koala.gif"></td>
 </tr>
 <tr>
   <td width=50% style="text-align:center;">badminton/2cls_wonder_woman_spiderman.yaml</td>
+  <td width=50% style="text-align:center;">soap-box/soap-box.yaml</td>
 </tr>
 <tr>
+  <td><img src="assets/instance-level/badminton.gif"></td>
+  <td><img src="assets/teaser/soap-box.gif"></td>
 </tr>
 <tr>
   <td width=50% style="text-align:center;">2_cats/4cls_panda_vs_poddle.yaml</td>
   <td width=50% style="text-align:center;">2_cars/left_firetruck_right_bus.yaml</td>
 </tr>
 <tr>
+  <td><img src="assets/instance-level/panda_vs_poddle.gif"></td>
+  <td><img src="assets/instance-level/2cars.gif"></td>
+</tr>
+</table>
+## 💃 Instance-level Video Editing
+You can get instance-level video editing results, using the following command:
+```bash
+CUDA_VISIBLE_DEVICES=0 accelerate launch test.py --config  config/instance_level/running_two_man/running_3cls_iron_spider.yaml
+```
+<table class="center">
+<tr>
+  <td><img src="assets/part-level/man_text_message.gif"></td>
+  <td><img src="assets/part-level/blue-shirt.gif"></td>
+  <td><img src="assets/part-level/blue-shirt.gif"></td>
+  <td><img src="assets/part-level/cat_flower.gif"></td>
+  <td><img src="assets/part-level/ginger_head.gif"></td>
+  <td><img src="assets/part-level/ginger_body.gif"></td>
+</tr>
+<tr>
+  <td width=30% style="text-align:center;">source video</td>
+  <td width=30% style="text-align:center;">blue shirt</td>
+  <td width=30% style="text-align:center;">black suit</td>
+  <td width=30% style="text-align:center;">source video</td>
+  <td width=30% style="text-align:center;">head color: black→ ginger</td>
+  <td width=30% style="text-align:center;">body color: black → ginger</td>
+</tr>
+<tr>
+  <td><img src="assets/part-level/superman_cap.gif"></td>
+  <td><img src="assets/part-level/superman_sunglass.gif"></td>
+  <td><img src="assets/part-level/thor_sunglass.gif"></td>
+</tr>
+<tr>
+  <td width=30% style="text-align:center;">superman+cap</td>
+  <td width=30% style="text-align:center;">superman+sunglasses</td>
+  <td width=30% style="text-align:center;">thor+sunglasses+red gloves</td>
 </tr>
 </table>

assets/{teaser → instance-level}/2cars.gif RENAMED Viewed

File without changes

assets/{teaser → instance-level}/badminton.gif RENAMED Viewed

File without changes

assets/{teaser → instance-level}/bike_3.gif RENAMED Viewed

File without changes

assets/{teaser → instance-level}/left_iron_right_spider.gif RENAMED Viewed

File without changes

assets/{teaser → instance-level}/panda_vs_poddle.gif RENAMED Viewed

File without changes

assets/{teaser → instance-level}/teddy_koala.gif RENAMED Viewed

File without changes

assets/part-level/black-suit.gif ADDED Viewed

Git LFS Details

SHA256: 2caa5ab48520c0ae4ed473bfa55c2c6d23096c27ccb8228ca4020f6eda5f93b0
Pointer size: 132 Bytes
Size of remote file: 2.54 MB

assets/part-level/blue-shirt.gif ADDED Viewed

Git LFS Details

SHA256: c9407389076965888e3ad85b3692bf4e843799e3cff362ab186e8de54e1f8b9d
Pointer size: 132 Bytes
Size of remote file: 2.42 MB

assets/part-level/cat_flower.gif ADDED Viewed

Git LFS Details

SHA256: 8fd289486401773e323981d3cf40bf1fb1c1dc78839193d73bf695d21fa9add5
Pointer size: 132 Bytes
Size of remote file: 1.75 MB

assets/part-level/ginger_body.gif ADDED Viewed

Git LFS Details

SHA256: 5dc6601bbb1a002273fa419317aee2b163df495fc12d6880a87697e91b789be1
Pointer size: 132 Bytes
Size of remote file: 1.58 MB

assets/part-level/ginger_head.gif ADDED Viewed

Git LFS Details

SHA256: b2ffe9f495e6d56d67397a545ef25276c469807bbd5bde21902db243abca0b4c
Pointer size: 132 Bytes
Size of remote file: 1.55 MB

assets/part-level/man_text_message.gif ADDED Viewed

Git LFS Details

SHA256: 2870554941cfeeaff4deac66ae2f9552595bc3396c8e25b2d7effd6fa3a856e8
Pointer size: 132 Bytes
Size of remote file: 2.62 MB

assets/part-level/superman_cap.gif ADDED Viewed

Git LFS Details

SHA256: a8c422da080d42580089e35528720efd0390067558cdb5dcd4a4ea9c3bf3ae79
Pointer size: 132 Bytes
Size of remote file: 3.29 MB

assets/part-level/superman_sunglass.gif ADDED Viewed

Git LFS Details

SHA256: ae269fa1e139d287b5d4a59b7931bd34ff491cf12c316449d3b3a507344bc8bc
Pointer size: 132 Bytes
Size of remote file: 1.75 MB

assets/part-level/thor_sunglass.gif ADDED Viewed

Git LFS Details

SHA256: 4a185e23d6bffe4c858a6d88800a3b12f51dee6522755d8f89c30de05928a47c
Pointer size: 132 Bytes
Size of remote file: 7.72 MB

config/class_level/running_two_man/{running_man2spider.yaml → man2spider.yaml} RENAMED Viewed

File without changes

config/instance_level/2_cars/{2cars_left_firetruck_right_school_bus.yaml → left_firetruck_right_bus.yaml} RENAMED Viewed

File without changes

config/instance_level/2_cars/{2cars_left_firetruck_right_school_bus_preserve_bg.yaml → left_firetruck_right_school_bus_preserve_bg.yaml} RENAMED Viewed

File without changes

config/instance_level/2_cats/{2cats_3cls_samoyed_vs_tiger_sunrise.yaml → 3cls_samoyed_vs_tiger_sunrise.yaml} RENAMED Viewed

File without changes

config/instance_level/2_cats/{2cats_4cls_panda_vs_poddle.yaml → 4cls_panda_vs_poddle.yaml} RENAMED Viewed

File without changes

config/instance_level/2_monkeys/{monkeys_2cls_teddy_bear_golden_retriever.yaml → 2cls_teddy_bear_golden_retriever.yaml} RENAMED Viewed

File without changes

config/instance_level/2_monkeys/{monkeys_2cls_teddy_bear_koala.yaml → 2cls_teddy_bear_koala.yaml} RENAMED Viewed

File without changes

config/instance_level/badminton/{badminton_2cls_wonder_woman_spiderman.yaml → 2cls_wonder_woman_spiderman.yaml} RENAMED Viewed

File without changes

config/instance_level/running_two_man/{running_3cls_iron_spider.yaml → 3cls_iron_spider.yaml} RENAMED Viewed

File without changes

config/instance_level/running_two_man/{running_3cls_polar_spider_vis_weight.yaml → 3cls_spider_polar_vis_weight.yaml} RENAMED Viewed

File without changes

config/instance_level/running_two_man/{running_4cls_spider_polar.yaml → 4cls_spider_polar.yaml} RENAMED Viewed

File without changes

config/part_level/{part_level_modification → modification}/cat_flower/ginger_body.yaml RENAMED Viewed

File without changes

config/part_level/{part_level_modification → modification}/cat_flower/ginger_head.yaml RENAMED Viewed

File without changes

config/part_level/{part_level_modification → modification}/man_text_message/black_suit.yaml RENAMED Viewed

File without changes

config/part_level/{part_level_modification → modification}/man_text_message/blue_shirt.yaml RENAMED Viewed

File without changes