Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
toshasย 
posted an update Dec 28, 2023
Post
Introducing Marigold ๐ŸŒผ - a universal monocular depth estimator, delivering incredibly sharp predictions in the wild! Based on Stable Diffusion, it is trained with synthetic depth data only and excels in zero-shot adaptation to real-world imagery. Check it out:

๐Ÿค— Hugging Face Space: https://huggingface.co/spaces/toshas/marigold
๐Ÿค— Hugging Face Model: https://huggingface.co/Bingxin/Marigold
๐Ÿค— Hugging Face Paper: Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation (2312.02145)
๐ŸŒ Website: https://marigoldmonodepth.github.io
๐Ÿ‘พ Code: https://github.com/prs-eth/marigold
๐Ÿ‘พ Code: pip install diffusers (check comments to this post for details!)
๐Ÿ“„ Paper: https://arxiv.org/abs/2312.02145

Brought to you by the fantastic team from the Photogrammetry and Remote Sensing group of ETH Zurich: Bingxin Ke ( @Bingxin ), Anton Obukhov ( @toshas ), Shengyu Huang, Nando Metzger ( @nandometzger ), Rodrigo Caye Daudt, and Konrad Schindler.

Super cool that it comes with a Spaces demo ๐Ÿ”ฅ
Linking the HF paper page as well: https://huggingface.co/papers/2312.02145
Thank you for sharing!

ยท

Updated to include the paper!

Super cool work.

Anyone curious, you can try out Marigold in diffusers through a custom pipeline too. Check it out here: https://github.com/huggingface/diffusers/tree/main/examples/community#marigold-depth-estimation.