README.md

metadata

title: 360° Video Photogrammetry - Outdoor Edition
emoji: 🌍
colorFrom: green
colorTo: blue
sdk: gradio
sdk_version: 5.49.1
app_file: app.py
pinned: false
license: mit

🌍 360° Video to 3D Model - Outdoor Photogrammetry

Convert your outdoor 360° videos into frame sequences ready for 3D photogrammetry reconstruction!

🎯 What This App Does

This application extracts frames from 360° videos and prepares them for photogrammetry software like:

• Agisoft Metashape (recommended for 360° spherical input)
• RealityCapture (fast processing)
• Meshroom (free, open-source)
• 3DF Zephyr (good free tier)

🌲 Perfect For Outdoor Scenes

This tool is optimized for outdoor 360° photogrammetry of:

• 🏔️ Landscapes and natural formations
• 🏛️ Buildings and monuments
• 🌳 Archaeological sites
• 🏞️ Parks and outdoor venues
• 🗿 Rock formations and cliffs
• 🏘️ Urban environments

📸 Outdoor Capture Tips

Best Lighting Conditions

• ☁️ Overcast days - Most consistent lighting, no harsh shadows
• 🌅 Golden hour - Soft, warm light (early morning or late afternoon)
• ❌ Avoid midday sun - Creates harsh shadows that confuse algorithms

Camera Movement

• 🚶 Move smoothly and steadily through the scene
• ⚖️ Maintain consistent distance from subjects
• 🔄 Capture multiple angles of important features
• 📐 Keep consistent elevation when possible

Scene Considerations

• 🍃 Moving vegetation - Wind causes leaves/branches to move between frames
• 🚗 Moving objects - Cars, people, animals can create artifacts
• 💧 Reflective surfaces - Water, glass, metal may cause issues
• ☁️ Sky/clouds - Will create points, filter them out later
• 🌊 Water - Especially challenging due to reflections and movement

🎬 How to Use

1. Upload your 360° video (MP4 format)
2. Set frame interval (1-2 seconds typical for outdoor scenes)
3. Set max frames (50-150 frames typical for outdoor areas)
4. Click "Extract Frames"
5. Download the ZIP package containing:
   • Extracted frames as high-quality JPEGs
   • Detailed README with processing instructions
   • Outdoor-specific photogrammetry tips

🛠️ Next Steps After Download

Using Agisoft Metashape (Recommended)

1. Import frames into Metashape
2. Set camera type to "Spherical"
3. Align photos with "Sequential" preselection
4. Build dense cloud (use "Moderate" depth filtering for outdoor scenes)
5. Build mesh
6. Build texture
7. Clean up sky points and artifacts

Outdoor Scene Post-Processing

Sky Removal:

• Use selection tools to identify sky points
• Delete or adjust bounding box to exclude sky

Moving Object Cleanup:

• Use "Gradual Selection" → "Reconstruction Uncertainty"
• Remove points with high uncertainty values

Vegetation Handling:

• Accept that fine details may be approximate
• Use dense sampling (more frames) for better results

💻 Hardware Requirements

For outdoor photogrammetry processing:

• CPU: 8+ cores, 3.5GHz+
• RAM: 32GB minimum, 64GB recommended
• GPU: 8GB+ VRAM (16GB for large outdoor scenes)
• Storage: SSD with plenty of free space

📊 Recommended Settings by Scene Type

Scene Type	Frame Interval	Max Frames	Notes
Large landscape	2-3 seconds	80-120	Cover more ground
Building facade	1-2 seconds	100-150	Need detail
Dense forest	0.5-1 second	150-200	Lots of occlusion
Open monument	1-2 seconds	60-100	Less complexity

⚠️ Common Outdoor Challenges

Challenge: Inconsistent Lighting

Problem: Clouds move, changing light between frames
Solution: Process on consistent weather days, or use HDR capture

Challenge: Moving Trees/Grass

Problem: Wind creates motion blur and position changes
Solution: Shoot on calm days, or increase frame rate and use more frames

Challenge: Large Scale

Problem: Outdoor scenes can span hundreds of meters
Solution: Break into sections, or use GPS/GCP for accuracy

Challenge: Sky Dominates

Problem: Too many points generated for sky/clouds
Solution: Post-process to remove sky, or mask during capture

📚 Resources

• Agisoft Metashape Manual
• Mantis Sub Academy
• OpenDroneMap Documentation
• Meshroom Documentation

🤝 Contributing

This is an open-source tool for the photogrammetry community. Contributions welcome!

📝 License

MIT License - Feel free to use and modify for your projects!

---

Note: This app only extracts frames. You'll need separate photogrammetry software (like Metashape) to create the actual 3D model.

Made with ❤️ for outdoor 360° photogrammetry enthusiasts!