Geometric Reciprocity: Unlocking Self-Supervision for Stereoscopic Video Generation
Abstract
A self-supervised framework for monocular-to-stereo conversion uses geometric reciprocity theorem to enable training from monocular videos without requiring stereo pairs or synthetic data.
Monocular-to-stereo conversion synthesizes stereoscopic content from 2D videos for immersive 3D experiences. In modern Depth-Image-Based Rendering (DIBR) approaches, stereo inpainting of disocclusions is the critical bottleneck. Training-based methods achieve superior quality but rely on scarce stereo pairs or synthetic data with domain gaps. We address this through the first self-supervised framework learning from monocular videos via cycle consistency. Our key contribution is the Geometric Reciprocity Theorem (GRT): under the nearest-neighbor DIBR formulation, the disocclusion mask when synthesizing a target view equals the mask of pixels lost when warping back from target to source, enabling analytical computation of test-time disocclusion masks directly from monocular images. This yields train-test consistency for the stated warping formulation, supporting self-supervised learning from unlimited monocular videos and substantial improvements over training-free and supervised state-of-the-art methods. Project page: https://visual-ai.github.io/grt/
Get this paper in your agent:
hf papers read 2607.05354 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 2
LuJingyi/kinetics400-grt-video-masks
LuJingyi/grt-davis-eval-masks
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper