Hugging Face's logo

Spaces:
Insta360-Research
/
UniSHARP
Running on Zero

App Files Community
Insta360-Research commited on
Commit
a87ad31
·
verified ·
1 Parent(s): 6531299

Update demo examples, intro links, and output frame height

Browse files
Files changed (33) hide show
  1. .gitattributes +30 -0
  2. app.py +62 -8
  3. examples/omnirooms/AI_vol3_01_last_source.jpg +0 -3
  4. examples/{omnirooms/AIUE5_vol8_05_random_source.jpg → replica/replica_apartment_0_0000_g00249.png} +2 -2
  5. examples/{omnirooms/AI_vol4_03_middle_source.jpg → replica/replica_apartment_0_0000_g01456.png} +2 -2
  6. examples/{omnirooms/AI_vol3_04_first_source.jpg → replica/replica_apartment_0_0000_g01523.png} +2 -2
  7. examples/{omnirooms/AI_vol3_04_last_source.jpg → replica/replica_apartment_0_0002_g00379.png} +2 -2
  8. examples/replica/replica_apartment_0_0002_g00968.png +3 -0
  9. examples/replica/replica_apartment_0_0002_g01122.png +3 -0
  10. examples/replica/replica_apartment_0_0002_g01412.png +3 -0
  11. examples/replica/replica_apartment_0_0002_g01481.png +3 -0
  12. examples/replica/replica_apartment_0_0004_g00631.png +3 -0
  13. examples/replica/replica_apartment_0_0004_g01035.png +3 -0
  14. examples/replica/replica_apartment_0_0004_g01189.png +3 -0
  15. examples/replica/replica_apartment_0_0004_g01541.png +3 -0
  16. examples/replica/replica_apartment_0_0004_g01786.png +3 -0
  17. examples/replica/replica_apartment_1_0000_g00628.png +3 -0
  18. examples/replica/replica_apartment_1_0000_g01186.png +3 -0
  19. examples/replica/replica_apartment_1_0000_g01259.png +3 -0
  20. examples/replica/replica_apartment_1_0000_g01402.png +3 -0
  21. examples/replica/replica_apartment_1_0000_g01539.png +3 -0
  22. examples/replica/replica_apartment_1_0000_g01604.png +3 -0
  23. examples/replica/replica_apartment_1_0000_g01727.png +3 -0
  24. examples/replica/replica_apartment_1_0000_g01969.png +3 -0
  25. examples/replica/replica_apartment_1_0001_g00895.png +3 -0
  26. examples/replica/replica_apartment_1_0001_g01202.png +3 -0
  27. examples/replica/replica_apartment_1_0001_g01485.png +3 -0
  28. examples/replica/replica_apartment_1_0001_g01551.png +3 -0
  29. examples/replica/replica_apartment_1_0001_g01975.png +3 -0
  30. examples/replica/replica_apartment_1_0002_g00410.png +3 -0
  31. examples/replica/replica_apartment_1_0002_g00588.png +3 -0
  32. examples/replica/replica_office_3_0000_g01465.png +3 -0
  33. examples/replica/replica_office_3_0000_g01532.png +3 -0
.gitattributes CHANGED
@@ -4,3 +4,33 @@
4
  *.bin filter=lfs diff=lfs merge=lfs -text
5
  examples/omnirooms/*.jpg filter=lfs diff=lfs merge=lfs -text
6
  unisharp/cli/__pycache__/unified_trainer.cpython-313.pyc filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  *.bin filter=lfs diff=lfs merge=lfs -text
5
  examples/omnirooms/*.jpg filter=lfs diff=lfs merge=lfs -text
6
  unisharp/cli/__pycache__/unified_trainer.cpython-313.pyc filter=lfs diff=lfs merge=lfs -text
7
+ examples/replica/replica_apartment_0_0000_g00249.png filter=lfs diff=lfs merge=lfs -text
8
+ examples/replica/replica_apartment_0_0000_g01456.png filter=lfs diff=lfs merge=lfs -text
9
+ examples/replica/replica_apartment_0_0000_g01523.png filter=lfs diff=lfs merge=lfs -text
10
+ examples/replica/replica_apartment_0_0002_g00379.png filter=lfs diff=lfs merge=lfs -text
11
+ examples/replica/replica_apartment_0_0002_g00968.png filter=lfs diff=lfs merge=lfs -text
12
+ examples/replica/replica_apartment_0_0002_g01122.png filter=lfs diff=lfs merge=lfs -text
13
+ examples/replica/replica_apartment_0_0002_g01412.png filter=lfs diff=lfs merge=lfs -text
14
+ examples/replica/replica_apartment_0_0002_g01481.png filter=lfs diff=lfs merge=lfs -text
15
+ examples/replica/replica_apartment_0_0004_g00631.png filter=lfs diff=lfs merge=lfs -text
16
+ examples/replica/replica_apartment_0_0004_g01035.png filter=lfs diff=lfs merge=lfs -text
17
+ examples/replica/replica_apartment_0_0004_g01189.png filter=lfs diff=lfs merge=lfs -text
18
+ examples/replica/replica_apartment_0_0004_g01541.png filter=lfs diff=lfs merge=lfs -text
19
+ examples/replica/replica_apartment_0_0004_g01786.png filter=lfs diff=lfs merge=lfs -text
20
+ examples/replica/replica_apartment_1_0000_g00628.png filter=lfs diff=lfs merge=lfs -text
21
+ examples/replica/replica_apartment_1_0000_g01186.png filter=lfs diff=lfs merge=lfs -text
22
+ examples/replica/replica_apartment_1_0000_g01259.png filter=lfs diff=lfs merge=lfs -text
23
+ examples/replica/replica_apartment_1_0000_g01402.png filter=lfs diff=lfs merge=lfs -text
24
+ examples/replica/replica_apartment_1_0000_g01539.png filter=lfs diff=lfs merge=lfs -text
25
+ examples/replica/replica_apartment_1_0000_g01604.png filter=lfs diff=lfs merge=lfs -text
26
+ examples/replica/replica_apartment_1_0000_g01727.png filter=lfs diff=lfs merge=lfs -text
27
+ examples/replica/replica_apartment_1_0000_g01969.png filter=lfs diff=lfs merge=lfs -text
28
+ examples/replica/replica_apartment_1_0001_g00895.png filter=lfs diff=lfs merge=lfs -text
29
+ examples/replica/replica_apartment_1_0001_g01202.png filter=lfs diff=lfs merge=lfs -text
30
+ examples/replica/replica_apartment_1_0001_g01485.png filter=lfs diff=lfs merge=lfs -text
31
+ examples/replica/replica_apartment_1_0001_g01551.png filter=lfs diff=lfs merge=lfs -text
32
+ examples/replica/replica_apartment_1_0001_g01975.png filter=lfs diff=lfs merge=lfs -text
33
+ examples/replica/replica_apartment_1_0002_g00410.png filter=lfs diff=lfs merge=lfs -text
34
+ examples/replica/replica_apartment_1_0002_g00588.png filter=lfs diff=lfs merge=lfs -text
35
+ examples/replica/replica_office_3_0000_g01465.png filter=lfs diff=lfs merge=lfs -text
36
+ examples/replica/replica_office_3_0000_g01532.png filter=lfs diff=lfs merge=lfs -text
app.py CHANGED
@@ -81,10 +81,57 @@ LOCAL_CHECKPOINT_PATH = Path(
81
  )
82
  OUTPUT_ROOT = Path(os.environ.get("UNISHARP_OUTPUT_DIR", "/tmp/unisharp_outputs"))
83
  STABLE_INPUT_PATH = Path(os.environ.get("UNISHARP_STABLE_INPUT", "/tmp/unisharp_current_input.png"))
84
- EXAMPLE_IMAGE_DIR = ROOT / "examples" / "omnirooms"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
85
 
86
  DEFAULT_PERSPECTIVE_MAX_LONG_EDGE = 768
87
- DEFAULT_PANORAMA_MAX_LONG_EDGE = 1536
88
  DEFAULT_ORBIT_VIEWS = 10
89
  DEFAULT_FORWARD_VIEWS = 10
90
  DEFAULT_ORBIT_RADIUS_M = 0.10
@@ -377,7 +424,12 @@ def run_unisharp(
377
 
378
 
379
  def _example_paths() -> list[Path]:
380
- return sorted([*EXAMPLE_IMAGE_DIR.glob("*.jpg"), *EXAMPLE_IMAGE_DIR.glob("*.JPG")])
 
 
 
 
 
381
 
382
 
383
  def _demo_gallery_items() -> list[str]:
@@ -537,13 +589,15 @@ CSS = """
537
  INTRO = """
538
  # UniSHARP
539
 
 
 
540
  Here are our resources:
541
 
542
  - **💻 Code:** https://github.com/Insta360-Research-Team/UniSHARP
543
- - **🌐 Web Page:** https://insta360-research-team.github.io/UniSHARP/
 
 
544
  - **🤗 Demo:** https://huggingface.co/spaces/Insta360-Research/UniSHARP
545
-
546
- Official Gradio demo for **UniSHARP**, a single-image 3D Gaussian rendering model.
547
  """
548
 
549
 
@@ -594,7 +648,7 @@ with gr.Blocks(title="UniSHARP", css=CSS, theme=THEME) as demo:
594
  label="Forward View",
595
  type="filepath",
596
  sources=[],
597
- height=380,
598
  interactive=False,
599
  show_download_button=False,
600
  show_share_button=False,
@@ -605,7 +659,7 @@ with gr.Blocks(title="UniSHARP", css=CSS, theme=THEME) as demo:
605
  label="Orbit View",
606
  type="filepath",
607
  sources=[],
608
- height=380,
609
  interactive=False,
610
  show_download_button=False,
611
  show_share_button=False,
 
81
  )
82
  OUTPUT_ROOT = Path(os.environ.get("UNISHARP_OUTPUT_DIR", "/tmp/unisharp_outputs"))
83
  STABLE_INPUT_PATH = Path(os.environ.get("UNISHARP_STABLE_INPUT", "/tmp/unisharp_current_input.png"))
84
+ EXAMPLE_REPLICA_DIR = ROOT / "examples" / "replica"
85
+ EXAMPLE_OMNIROOMS_DIR = ROOT / "examples" / "omnirooms"
86
+
87
+ REPLICA_EXAMPLE_NAMES = [
88
+ "replica_apartment_0_0004_g01189",
89
+ "replica_apartment_0_0004_g00631",
90
+ "replica_apartment_0_0004_g01541",
91
+ "replica_apartment_0_0002_g01481",
92
+ "replica_apartment_0_0004_g01035",
93
+ "replica_apartment_1_0000_g00628",
94
+ "replica_apartment_0_0004_g01786",
95
+ "replica_apartment_1_0001_g00895",
96
+ "replica_apartment_1_0000_g01727",
97
+ "replica_apartment_0_0002_g01122",
98
+ "replica_apartment_1_0000_g01969",
99
+ "replica_apartment_0_0002_g00379",
100
+ "replica_apartment_1_0000_g01186",
101
+ "replica_apartment_1_0002_g00410",
102
+ "replica_apartment_1_0001_g01485",
103
+ "replica_apartment_1_0001_g01202",
104
+ "replica_apartment_1_0001_g01975",
105
+ "replica_apartment_0_0002_g01412",
106
+ "replica_apartment_1_0000_g01259",
107
+ "replica_apartment_0_0002_g00968",
108
+ "replica_apartment_1_0000_g01402",
109
+ "replica_apartment_1_0000_g01539",
110
+ "replica_apartment_0_0000_g01523",
111
+ "replica_apartment_0_0000_g01456",
112
+ "replica_apartment_0_0000_g00249",
113
+ "replica_office_3_0000_g01465",
114
+ "replica_apartment_1_0001_g01551",
115
+ "replica_apartment_1_0002_g00588",
116
+ "replica_office_3_0000_g01532",
117
+ "replica_apartment_1_0000_g01604",
118
+ ]
119
+
120
+ OMNIROOMS_EXAMPLE_NAMES = [
121
+ "AI_vol4_02_last_source.jpg",
122
+ "AI_vol3_03_first_source.jpg",
123
+ "AI_vol4_03_random_source.jpg",
124
+ "AI_vol4_02_random_source.jpg",
125
+ "AI_vol4_03_last_source.jpg",
126
+ "AI_vol4_04_random_source.jpg",
127
+ "AI_vol4_05_last_source.jpg",
128
+ "AI_vol4_05_middle_source.jpg",
129
+ "AI_vol4_02_middle_source.jpg",
130
+ "AIUE_V01_004_random_source.jpg",
131
+ ]
132
 
133
  DEFAULT_PERSPECTIVE_MAX_LONG_EDGE = 768
134
+ DEFAULT_PANORAMA_MAX_LONG_EDGE = 0
135
  DEFAULT_ORBIT_VIEWS = 10
136
  DEFAULT_FORWARD_VIEWS = 10
137
  DEFAULT_ORBIT_RADIUS_M = 0.10
 
424
 
425
 
426
  def _example_paths() -> list[Path]:
427
+ paths: list[Path] = []
428
+ for name in REPLICA_EXAMPLE_NAMES:
429
+ paths.append(EXAMPLE_REPLICA_DIR / f"{name}.png")
430
+ for name in OMNIROOMS_EXAMPLE_NAMES:
431
+ paths.append(EXAMPLE_OMNIROOMS_DIR / name)
432
+ return [path for path in paths if path.is_file()]
433
 
434
 
435
  def _demo_gallery_items() -> list[str]:
 
589
  INTRO = """
590
  # UniSHARP
591
 
592
+ Predicts a 3D Gaussian point cloud from a single image across diverse camera models, enabling high-quality novel view synthesis.
593
+
594
  Here are our resources:
595
 
596
  - **💻 Code:** https://github.com/Insta360-Research-Team/UniSHARP
597
+ - **🌐 Web Page:** https://insta360-research-team.github.io/Unisharp-website/
598
+ - **📄 Paper:** (coming soon)
599
+ - **📦 Dataset:** https://huggingface.co/datasets/Insta360-Research/OmniRooms
600
  - **🤗 Demo:** https://huggingface.co/spaces/Insta360-Research/UniSHARP
 
 
601
  """
602
 
603
 
 
648
  label="Forward View",
649
  type="filepath",
650
  sources=[],
651
+ height=350,
652
  interactive=False,
653
  show_download_button=False,
654
  show_share_button=False,
 
659
  label="Orbit View",
660
  type="filepath",
661
  sources=[],
662
+ height=350,
663
  interactive=False,
664
  show_download_button=False,
665
  show_share_button=False,
examples/omnirooms/AI_vol3_01_last_source.jpg DELETED

Git LFS Details

  • SHA256: e7c4d09efa830a87a6fa04a4852b3067f8228ad43bcb36d47f7612ff5bb2533b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.2 MB
examples/{omnirooms/AIUE5_vol8_05_random_source.jpg → replica/replica_apartment_0_0000_g00249.png} RENAMED
File without changes
examples/{omnirooms/AI_vol4_03_middle_source.jpg → replica/replica_apartment_0_0000_g01456.png} RENAMED
File without changes
examples/{omnirooms/AI_vol3_04_first_source.jpg → replica/replica_apartment_0_0000_g01523.png} RENAMED
File without changes
examples/{omnirooms/AI_vol3_04_last_source.jpg → replica/replica_apartment_0_0002_g00379.png} RENAMED
File without changes
examples/replica/replica_apartment_0_0002_g00968.png ADDED

Git LFS Details

  • SHA256: 82322cbf31cb9a9700957cb109dc72c00df9c68bffd96e54c0cf9ae028fa1128
  • Pointer size: 131 Bytes
  • Size of remote file: 331 kB
examples/replica/replica_apartment_0_0002_g01122.png ADDED

Git LFS Details

  • SHA256: 067554fcea7d55ac4cf6d81bc6a891b53c5cdd47fa7e743924e5cd91e7677373
  • Pointer size: 131 Bytes
  • Size of remote file: 287 kB
examples/replica/replica_apartment_0_0002_g01412.png ADDED

Git LFS Details

  • SHA256: a92b22c699f6574bc65aeb78af96544d38a61bfb5d8b1521d04d2b387cd47717
  • Pointer size: 131 Bytes
  • Size of remote file: 302 kB
examples/replica/replica_apartment_0_0002_g01481.png ADDED

Git LFS Details

  • SHA256: c60b9f23c688dd43f170439133f84b799d880ac1f52be8250209122161448607
  • Pointer size: 131 Bytes
  • Size of remote file: 269 kB
examples/replica/replica_apartment_0_0004_g00631.png ADDED

Git LFS Details

  • SHA256: d72c22842fe762cf2b6e34e8dc94a1cce5e80d7cc5de00064283d2b4c8a46bed
  • Pointer size: 131 Bytes
  • Size of remote file: 270 kB
examples/replica/replica_apartment_0_0004_g01035.png ADDED

Git LFS Details

  • SHA256: 903681a94bb6911adb1ba18d6f5bdbb467e09fe1281e9a9ab65f6e46da9459ad
  • Pointer size: 131 Bytes
  • Size of remote file: 330 kB
examples/replica/replica_apartment_0_0004_g01189.png ADDED

Git LFS Details

  • SHA256: 42134a40f6507dfd46b32b4450234558cdb16c6e61b4f8830eccd5e6c506c987
  • Pointer size: 131 Bytes
  • Size of remote file: 328 kB
examples/replica/replica_apartment_0_0004_g01541.png ADDED

Git LFS Details

  • SHA256: 469f1c421097c319795971ef045c93226b83de5e5ed8cae116a2c6b5d051e794
  • Pointer size: 131 Bytes
  • Size of remote file: 335 kB
examples/replica/replica_apartment_0_0004_g01786.png ADDED

Git LFS Details

  • SHA256: b9e46c4424296b4723000f90fcd899f1235bcebf1c90c71eece8d271de8b6732
  • Pointer size: 131 Bytes
  • Size of remote file: 329 kB
examples/replica/replica_apartment_1_0000_g00628.png ADDED

Git LFS Details

  • SHA256: 5f386e8e39a58478d1efb14e7017b9d85533cf1797c5e71cd4611bbdccbb7fc8
  • Pointer size: 131 Bytes
  • Size of remote file: 310 kB
examples/replica/replica_apartment_1_0000_g01186.png ADDED

Git LFS Details

  • SHA256: 9f9352f2ce854182e727706fe434ddadd2e4eab8bf476218f04e258f022853f4
  • Pointer size: 131 Bytes
  • Size of remote file: 300 kB
examples/replica/replica_apartment_1_0000_g01259.png ADDED

Git LFS Details

  • SHA256: a53dd5469987056bb78834d1acce2eda2069993a6fe1c13fb06f534895b35230
  • Pointer size: 131 Bytes
  • Size of remote file: 379 kB
examples/replica/replica_apartment_1_0000_g01402.png ADDED

Git LFS Details

  • SHA256: 08d92b274cfcf7998878e764ff8fb2240e87300dfbfc8aedf50ca4a79c0b09d1
  • Pointer size: 131 Bytes
  • Size of remote file: 357 kB
examples/replica/replica_apartment_1_0000_g01539.png ADDED

Git LFS Details

  • SHA256: 462247b1e4aa1e8eb81a095cbe9194c9ed968bb733c5dde77006760c8556bc83
  • Pointer size: 131 Bytes
  • Size of remote file: 322 kB
examples/replica/replica_apartment_1_0000_g01604.png ADDED

Git LFS Details

  • SHA256: 48ecf7d887994736d4a2fcf052cfa6ebae3a9a975ca1e040497ccc3acc624576
  • Pointer size: 131 Bytes
  • Size of remote file: 328 kB
examples/replica/replica_apartment_1_0000_g01727.png ADDED

Git LFS Details

  • SHA256: f27c66814a454878ff48965d0dad2c620d308dc96be004c389df7391895aefbc
  • Pointer size: 131 Bytes
  • Size of remote file: 331 kB
examples/replica/replica_apartment_1_0000_g01969.png ADDED

Git LFS Details

  • SHA256: 11ce7b6447d4ed2c90f55156c2500fa431d22ebbec79b8476d4ec149e69d8fee
  • Pointer size: 131 Bytes
  • Size of remote file: 308 kB
examples/replica/replica_apartment_1_0001_g00895.png ADDED

Git LFS Details

  • SHA256: a6371cb7a73c39220bcbbb20b522f107f7cf1486124081096496d580bc7f6845
  • Pointer size: 131 Bytes
  • Size of remote file: 320 kB
examples/replica/replica_apartment_1_0001_g01202.png ADDED

Git LFS Details

  • SHA256: 8b1e226f17f8409723a20651ea3f59e6bec4aecb6a70cde46eac181361e1789e
  • Pointer size: 131 Bytes
  • Size of remote file: 322 kB
examples/replica/replica_apartment_1_0001_g01485.png ADDED

Git LFS Details

  • SHA256: 83be877e2eb748aa520c934354b10dd1fe01d18832b422d809583a526fac0804
  • Pointer size: 131 Bytes
  • Size of remote file: 327 kB
examples/replica/replica_apartment_1_0001_g01551.png ADDED

Git LFS Details

  • SHA256: c3ae1cb5266fbe6f38c9ce42c2acf0605f70ea128873e3cf84f7fe03fb640362
  • Pointer size: 131 Bytes
  • Size of remote file: 322 kB
examples/replica/replica_apartment_1_0001_g01975.png ADDED

Git LFS Details

  • SHA256: 3bd726aa2a1bd98a6d0a5625c774c233379a5eb26424bd2920d3a6730a6bf986
  • Pointer size: 131 Bytes
  • Size of remote file: 324 kB
examples/replica/replica_apartment_1_0002_g00410.png ADDED

Git LFS Details

  • SHA256: b79c75eda0ec4a058be59a5e85ae3c3bb04acd960292d620cac19e1fbd5e2b44
  • Pointer size: 131 Bytes
  • Size of remote file: 317 kB
examples/replica/replica_apartment_1_0002_g00588.png ADDED

Git LFS Details

  • SHA256: 903cb058f7728946f9637f83df2227952ec120c2deeae1fb0d66a2d1bc3d4aa8
  • Pointer size: 131 Bytes
  • Size of remote file: 327 kB
examples/replica/replica_office_3_0000_g01465.png ADDED

Git LFS Details

  • SHA256: ffc77abe8a3b6a288cf710315aced2eaa09a2bc796e2689f2b3cc469def95f6c
  • Pointer size: 131 Bytes
  • Size of remote file: 327 kB
examples/replica/replica_office_3_0000_g01532.png ADDED

Git LFS Details

  • SHA256: 62f1aa1c30d5d6291a65995590606472b29100089bbb4a014855fd7e174023cd
  • Pointer size: 131 Bytes
  • Size of remote file: 329 kB