README.md

metadata

title: LingBot-Map Streaming 3D Reconstruction
emoji: 🗺️
colorFrom: indigo
colorTo: green
sdk: gradio
sdk_version: 5.50.0
app_file: app.py
pinned: false
license: apache-2.0
models:
  - robbyant/lingbot-map
tags:
  - 3d-reconstruction
  - point-cloud
  - computer-vision
  - arxiv:2604.14141
short_description: Community demo of LingBot-Map streaming 3D reconstruction

🗺️ LingBot-Map — Streaming 3D Reconstruction

Upload a handful of images or a short video clip and get back a navigable 3D point cloud with the camera trajectory, exported as a GLB you can orbit right in the browser.

What this is

A community Gradio demo wrapping LingBot-Map (the robbyant/lingbot-map checkpoint) — not an official release. LingBot-Map is a feed-forward 3D foundation model for streaming reconstruction: it ingests frames one at a time with a paged-KV-cache transformer and predicts per-frame 3D points, depth, confidence, and camera poses.

What this build does carefully

• Uses the model's own GLB export (predictions_to_glb → gr.Model3D) for a clean, static point cloud that renders natively in the browser — no external 3D server to babysit.
• Runs on ZeroGPU: FlashInfer is swapped for the built-in SDPA attention fallback, so there's no per-hardware source build to fight.
• Feeds the exporter world-to-camera extrinsics (the convention it actually expects), so the camera frustums and scene orientation come out right.
• Caps the frame count before the GPU call and offloads outputs to CPU, so a job always fits the GPU time budget.

Tips for good results

• Keep it short — a few seconds of video, or up to ~48 frames. Longer inputs are capped.
• Frames should overlap and move smoothly (a slow pan or orbit). Disjoint, non-overlapping shots won't reconstruct well.
• Confidence filter drops the lowest-confidence percentage of points: higher = cleaner but sparser, lower = denser but noisier. You can re-tune it (and the camera toggle) without re-running the model.
• For ordered image uploads, name frames 000.jpg, 001.jpg, … — or just upload a video.

Credits & attribution

Built on LingBot-Map by the Robbyant Team (Apache-2.0). The upstream model builds on VGGT and DINOv2; FlashInfer was replaced with the SDPA fallback for ZeroGPU compatibility (an honest, useful note for anyone reproducing this).

• Model: https://huggingface.co/robbyant/lingbot-map
• Code: https://github.com/Robbyant/lingbot-map
• Paper: https://arxiv.org/abs/2604.14141

@article{chen2026geometric,
  title={Geometric Context Transformer for Streaming 3D Reconstruction},
  author={Chen, Lin-Zhuo and Gao, Jian and Chen, Yihang and Cheng, Ka Leong and Sun, Yipengjing and Hu, Liangxiao and Xue, Nan and Zhu, Xing and Shen, Yujun and Yao, Yao and Xu, Yinghao},
  journal={arXiv preprint arXiv:2604.14141},
  year={2026}
}

License

Apache-2.0 — see LICENSE.txt. Upstream copyright headers, including the Meta Platforms headers inherited from VGGT, are preserved.