yfcai commited on
Commit
9f3b380
·
verified ·
1 Parent(s): 35102ea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +49 -0
README.md CHANGED
@@ -1,3 +1,52 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ <div align="center">
5
+
6
+ <h1 style="margin-bottom: 0.2em;">
7
+ [ECCV 2026] MetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors
8
+ </h1>
9
+
10
+ <p style="font-size: 1.1em; margin: 0.2em 0;">
11
+ <a href="https://openreview.net/profile?id=%7EYufei_Cai1" target="_blank">Yufei Cai<sup>1</sup></a>&emsp;
12
+ <a href="https://nxsedson.github.io/" target="_blank">Xuesong Niu<sup>2*</sup></a>&emsp;
13
+ <a href="https://lupaopao.github.io/" target="_blank">Hao Lu<sup>3</sup></a>&emsp;
14
+ <a href="https://openreview.net/profile?id=~Kun_Gai1" target="_blank">Kun Gai<sup>2</sup></a>&emsp;
15
+ <a href="https://openreview.net/profile?id=~Kai_Wu7" target="_blank">Kai Wu<sup>2†</sup></a>&emsp;
16
+ <a href="https://guosheng.github.io/" target="_blank">Guosheng Lin<sup>1†</sup></a>
17
+ </p>
18
+
19
+ <p style="font-size: 0.95em; margin: 0.2em 0;">
20
+ <sup>1</sup> Nanyang Technological University &nbsp;·&nbsp;
21
+ <sup>2</sup> Kuaishou Technology &nbsp;·&nbsp;
22
+ </p>
23
+ <p style="font-size: 0.95em; margin: 0.2em 0;">
24
+ <sup>3</sup> The Hong Kong University of Science and Technology (Guangzhou)
25
+ </p>
26
+
27
+ <p style="font-size: 0.85em; margin: 0.2em 0;">
28
+ <sup>*</sup> Project lead &nbsp;&nbsp; <sup>†</sup> Corresponding author
29
+ </p>
30
+
31
+ <p style="margin: 0.8em 0;">
32
+ <a href="#" target="_blank"><img src="https://img.shields.io/static/v1?label=Arxiv&message=UniVideo&color=red&logo=arxiv" alt="arXiv link"></a>&nbsp;
33
+ <a href="https://prototypenx.github.io/MetaView/" target="_blank"><img src="https://img.shields.io/badge/Project-Homepage-green" alt="project homepage"></a>&nbsp;
34
+ <a href="#" target="_blank"><img src="https://img.shields.io/badge/🤗%20Hugging%20Face-Models-blue" alt="HF Models"></a>
35
+ </p>
36
+
37
+ </div>
38
+
39
+
40
+
41
+ <!-- Official implementation for the paper "**MetaView**: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors". -->
42
+
43
+ ## Overview
44
+
45
+ **MetaView** is a diffusion-based framework for high-fidelity monocular novel view synthesis that enables accurate rendering under large view changes from a single image.
46
+
47
+ Current generative novel view synthesis methods typically rely on restrictive explicit 3D reconstruction pipelines or use fully implicit scene modeling that suffers from scale drifting and poor geometry consistency. MetaView bridges this gap by combining implicit geometry modeling with minimal yet essential explicit 3D cues:
48
+
49
+ - **Scale-Aware Implicit Geometry Priors:** We extract hierarchical features and metric depth from a feed-forward geometry perception network (Depth Anything 3). These geometric signals are incorporated into the pretrained MM-DiT backbone (Qwen-Image-Edit) via non-invasive parallel attention layers, regularizing the spatial structure while preserving rich semantic knowledge.
50
+ - **Metric Scale Anchoring via Modified RoPE:** To overcome the scale drifting issue prevalent in fully implicit methods, we encode camera parameters into a modified Rotary Positional Encoding (PRoPE) and allocate an extra subspace for the *z*-axis. This explicitly injects metric scale cues, anchoring the generation to a consistent 3D metric space.
51
+
52
+ Given a single input image and a target camera pose, MetaView synthesizes the corresponding novel view with precise camera controllability, strong geometry consistency, and remarkable cross-domain generalization.