| | --- |
| | license: apache-2.0 |
| | language: |
| | - pt |
| | - en |
| | base_model: |
| | - stabilityai/stable-diffusion-1-5 |
| | pipeline_tag: image-to-3d |
| | tags: |
| | - text-to-3d |
| | - image-to-3d |
| | - 3d-generation |
| | - 3d-reconstruction |
| | - stable-diffusion |
| | - triposr |
| | - comfyui |
| | - mesh-generation |
| | - gpu-optimized |
| | - nvidia |
| | - pytorch |
| | library_name: pytorch |
| | metrics: |
| | - inference_time |
| | - vram_usage |
| | --- |
| | |
| | <div align="center"> |
| |
|
| | <table> |
| | <tr> |
| | <td align="center"> |
| |
|
| | ``` |
| | ββββββ ββββββββββββββ ββββββ βββ |
| | βββββββββββββββββββββββββββββββββββ |
| | βββββββββββββββββ ββββββ ββββββ |
| | βββββββββββββββββ ββββββ ββββββ |
| | βββ ββββββββββββββββββ βββββββ βββ |
| | βββ βββββββββββββββββ ββββββ βββ |
| | ``` |
| |
|
| | </td> |
| | </tr> |
| | </table> |
| |
|
| | # **AIEXX GenAI Image to 3D** |
| |
|
| | ### π Enterprise-Grade AI-Powered 3D Model Generation System |
| | **Transform Text & Images into Production-Ready 3D Assets in Seconds** |
| |
|
| | --- |
| |
|
| | [](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/releases) |
| | [](https://opensource.org/licenses/Apache-2.0) |
| | [](https://www.python.org/) |
| | [](https://pytorch.org/) |
| | [](https://developer.nvidia.com/cuda-toolkit) |
| |
|
| | [](https://www.nvidia.com/) |
| | [](https://github.com/comfyanonymous/ComfyUI) |
| | [](https://huggingface.co/) |
| | [](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D) |
| |
|
| | [](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/stargazers) |
| | [](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/network/members) |
| | [](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/issues) |
| |
|
| | --- |
| |
|
| | **[π Quick Start](#-quick-start)** β’ |
| | **[π Documentation](#-documentation)** β’ |
| | **[π¨ Workflows](#-workflows)** β’ |
| | **[βοΈ Tech Stack](#%EF%B8%8F-technology-stack)** β’ |
| | **[π Performance](#-performance-benchmarks)** β’ |
| | **[π€ Contributing](#-contributing)** |
| |
|
| | </div> |
| |
|
| | --- |
| |
|
| | ## π Overview |
| |
|
| | **AIEXX GenAI Image to 3D** is a professional, GPU-accelerated AI system for generating high-quality 3D models from text prompts or 2D images. Built on cutting-edge deep learning technologies, it delivers production-ready 3D assets in seconds. |
| |
|
| | ### π NEW: Standalone Image-to-3D System |
| |
|
| | **Transform any image into a 3D model locally - no compilation required!** |
| |
|
| | We've integrated **TripoSR** directly into the project with a custom implementation that works **without pytorch3d**. Simply drag and drop an image onto the launcher! |
| |
|
| | ```batch |
| | # Convert any image to 3D in seconds: |
| | AIEXX_IMAGE_TO_3D.bat your_photo.png |
| | # Output formats: OBJ, GLB, STL, PLY |
| | # Processing time: 30-70 seconds |
| | # Works 100% offline after first download |
| | ``` |
| |
|
| | β
**Features:** |
| | - π No compilation needed (pure Python) |
| | - πΌοΈ Drag-and-drop interface |
| | - π» Full GPU acceleration (RTX 5060) |
| | - π 100% local processing (privacy) |
| | - β‘ Professional quality output |
| |
|
| | π **See [COMO_USAR_IMAGE_TO_3D.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/COMO_USAR_IMAGE_TO_3D.md) for complete guide** |
| |
|
| | ### β¨ Key Features |
| |
|
| | ``` |
| | π― TEXT-TO-3D GENERATION |
| | ββ Natural language prompts to 3D models |
| | ββ Stable Diffusion 1.5 integration |
| | ββ Advanced negative prompting |
| | ββ 20-60 seconds per model |
| | |
| | πΌοΈ IMAGE-TO-3D CONVERSION |
| | ββ Single image to full 3D mesh |
| | ββ Multi-view reconstruction support |
| | ββ Automated texture generation |
| | ββ 15-30 seconds processing time |
| | |
| | β‘ GPU ACCELERATION |
| | ββ NVIDIA RTX 5060 optimized |
| | ββ CUDA 12.8 + cuDNN integration |
| | ββ BF16 mixed precision training |
| | ββ Flash Attention v2 support |
| | ββ PyTorch 2.7.0 performance mode |
| | |
| | π PROFESSIONAL OUTPUT |
| | ββ GLB/GLTF format export |
| | ββ PBR material support |
| | ββ Configurable mesh resolution |
| | ββ Blender/Unity/Unreal ready |
| | ``` |
| |
|
| | --- |
| |
|
| | ## π Quick Start |
| |
|
| | ### Prerequisites |
| |
|
| | | Component | Requirement | Status | |
| | |-----------|------------|--------| |
| | | **OS** | Windows 10/11 (64-bit) | β
| |
| | | **GPU** | NVIDIA RTX 5060 (8GB VRAM) | β
| |
| | | **RAM** | 16GB minimum, 32GB recommended | β
| |
| | | **Storage** | ~55GB free space | β
| |
| | | **Python** | 3.11.9 | β
| |
| |
|
| | ### Installation |
| |
|
| | #### Option 1: **One-Click Automated Installation** (β EASIEST - Recommended) |
| |
|
| | ```batch |
| | # 1. Clone the repository |
| | git clone https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D.git |
| | cd AIEXX_GENAI_IMAGE_TO_3D |
| | |
| | # 2. Run the automated installer |
| | 0-INSTALL_ALL_AUTOMATED.bat |
| | |
| | # That's it! The installer will: |
| | # β
Check system requirements |
| | # β
Install all dependencies automatically |
| | # β
Handle restart (run again after restart) |
| | # β
Download all models |
| | # β
Launch the system when done |
| | ``` |
| |
|
| | **Features:** |
| | - β¨ Single command installation |
| | - π Auto-resume after restart |
| | - π‘οΈ Error handling and recovery |
| | - π Progress tracking with checkpoints |
| | - π‘ Clear instructions at each step |
| |
|
| | See [INSTALACAO_AUTOMATIZADA.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/INSTALACAO_AUTOMATIZADA.md) for complete documentation. |
| |
|
| | #### Option 2: Step-by-Step Installation (Advanced Users) |
| |
|
| | ```batch |
| | # 1. Clone the repository |
| | git clone https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D.git |
| | cd AIEXX_GENAI_IMAGE_TO_3D |
| | |
| | # 2. Install Visual Studio Build Tools (β οΈ RESTART after this!) |
| | 1-INSTALL_VS_BUILDTOOLS_WINGET.bat |
| | |
| | # 3. Setup Python environment and dependencies |
| | 2-FIX_VENV_AND_INSTALL_TORCH_SCATTER.bat |
| | |
| | # 4. Install ComfyUI 3D Pack |
| | 3-RUN_INSTALL_3DPACK.bat |
| | |
| | # 5. Download AI models |
| | 4-DOWNLOAD_3D_MODELS.bat |
| | |
| | # 6. (Optional) Download Stable Diffusion models |
| | 5-SETUP_SD_MODELS.bat |
| | |
| | # 7. Launch the system |
| | 6-START_AIEXX.bat |
| | ``` |
| |
|
| | #### Option 3: Manual Setup |
| |
|
| | See [INSTALLATION.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/INSTALLATION.md) for detailed manual installation instructions. |
| |
|
| | ### First Run |
| |
|
| | 1. **Start the System** |
| | ```batch |
| | 6-START_AIEXX.bat |
| | ``` |
| |
|
| | 2. **Access Web Interface** |
| | - Open browser: **http://localhost:8188** |
| |
|
| | 3. **Load a Workflow** |
| | - Click **"Load"** β Select from `workflows/3d/` |
| | - Recommended first workflow: `03_triposr_single_image_to_mesh.json` |
| |
|
| | 4. **Generate Your First 3D Model** |
| | - Upload an image or enter a text prompt |
| | - Click **"Queue Prompt"** |
| | - Wait ~20-60 seconds |
| | - Download your `.glb` file from `ComfyUI/output/` |
| |
|
| | > π **Note:** See [ORDEM_DE_INSTALACAO.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/ORDEM_DE_INSTALACAO.md) for complete installation order and troubleshooting. |
| |
|
| | --- |
| |
|
| | ## π Documentation |
| |
|
| | | Document | Description | |
| | |----------|-------------| |
| | | [π ORDEM_DE_INSTALACAO.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/ORDEM_DE_INSTALACAO.md) | **Installation order and numbered scripts** | |
| | | [π COMO_USAR.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/COMO_USAR.md) | Complete usage guide (Portuguese) | |
| | | [π QUICK_START_GUIDE.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/QUICK_START_GUIDE.md) | Quick start guide | |
| | | [π§ INSTALLATION.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/INSTALLATION.md) | Detailed installation guide | |
| | | [π README_NEXT_STEPS.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/README_NEXT_STEPS.md) | Next steps after installation | |
| | | [βοΈ SETUP_COMPLETE_3D_SYSTEM.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/SETUP_COMPLETE_3D_SYSTEM.md) | Complete system setup | |
| | | [π RELEASE_GUIDE.md](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/blob/main/RELEASE_GUIDE.md) | Release and versioning guide | |
| |
|
| | --- |
| |
|
| | ## π¨ Workflows |
| |
|
| | ### Available Workflows |
| |
|
| | <table> |
| | <tr> |
| | <td width="33%"> |
| |
|
| | #### π’ Basic - TripoSR |
| | **`03_triposr_single_image_to_mesh.json`** |
| | |
| | **Pipeline:** |
| | ``` |
| | Image > TripoSR > GLB |
| | ``` |
| | |
| | **Specs:** |
| | - Time: ~15-30s |
| | - VRAM: 3-4GB |
| | - Best for: Quick prototypes |
| | |
| | </td> |
| | <td width="33%"> |
| | |
| | #### π΅ Intermediate - Prompt to 3D |
| | **`basic/AIEXX_prompt_to_3d_triposr.json`** |
| | |
| | **Pipeline:** |
| | ``` |
| | Prompt > SD 1.5 > TripoSR > GLB |
| | ``` |
| | |
| | **Specs:** |
| | - Time: ~25-40s |
| | - VRAM: 4-5GB |
| | - Best for: Text-based creation |
| | |
| | </td> |
| | <td width="33%"> |
| | |
| | #### π³ Advanced - InstantMesh |
| | **`advanced/AIEXX_prompt_to_3d_instantmesh.json`** |
| | |
| | **Pipeline:** |
| | ``` |
| | Prompt > SD > Zero123++ > InstantMesh > GLB |
| | ``` |
| | |
| | **Specs:** |
| | - Time: ~45-90s |
| | - VRAM: 5-6GB |
| | - Best for: High-quality output |
| | |
| | </td> |
| | </tr> |
| | </table> |
| | |
| | --- |
| | |
| | ## βοΈ Technology Stack |
| | |
| | ### Core AI/ML Technologies |
| | |
| | | Technology | Version | Purpose | |
| | |------------|---------|----------| |
| | | Python | 3.11.9 | Core Language | |
| | | PyTorch | 2.7.0+cu128 | Deep Learning Framework | |
| | | CUDA Toolkit | 12.8 | GPU Acceleration | |
| | | Stable Diffusion | 1.5 | Image Generation | |
| | | TripoSR | Latest | 3D Reconstruction | |
| | | torch_scatter | 2.1.2 | Sparse Operations | |
| | | ComfyUI | Latest | UI Framework | |
| | | ComfyUI-3D-Pack | Latest | 3D Nodes & Tools | |
| | |
| | --- |
| | |
| | ## π Performance Benchmarks |
| | |
| | ### Processing Times (RTX 5060 8GB) |
| | |
| | | Workflow | Input Type | Speed | VRAM Usage | |
| | |----------|-----------|-------|------------| |
| | | TripoSR (Image>3D) | Single Image | 15-30s | 3-4GB | |
| | | TripoSR (Prompt>3D) | Text Prompt | 25-40s | 4-5GB | |
| | | InstantMesh | Text Prompt | 45-90s | 5-6GB | |
| | | Zero123 Multi-View | Single Image | 30-60s | 4-5GB | |
| | |
| | --- |
| | |
| | ## π« Acknowledgments |
| | |
| | This project builds upon these amazing open-source projects: |
| | |
| | - **[ComfyUI](https://github.com/comfyanonymous/ComfyUI)** - Node-based Stable Diffusion GUI |
| | - **[Stable Diffusion](https://github.com/Stability-AI/stablediffusion)** - Text-to-image foundation |
| | - **[TripoSR](https://github.com/VAST-AI-Research/TripoSR)** - Fast 3D reconstruction from single images |
| | - **[PyTorch](https://pytorch.org/)** - Deep learning framework |
| | - **[PyTorch3D](https://pytorch3d.org/)** - 3D deep learning library |
| |
|
| | Special thanks to: |
| | - Stability AI for Stable Diffusion |
| | - NVIDIA for CUDA toolkit and GPU support |
| | - Hugging Face for model hosting |
| | - The entire open-source AI community |
| |
|
| | --- |
| |
|
| | ## π§ Support & Community |
| |
|
| | - **Issues:** [GitHub Issues](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/issues) |
| | - **Docs:** [GitHub Wiki](https://github.com/AIExxplorer/AIEXX_GENAI_IMAGE_TO_3D/wiki) |
| | - **Email:** [aiexxplorer@artificialuniverse.tech](mailto:aiexxplorer@artificialuniverse.tech) |
| |
|
| | --- |
| |
|
| | ## π« License |
| |
|
| | This project is licensed under the **Apache 2.0 License** - see the [LICENSE](LICENSE) file for details. |
| |
|
| | --- |
| |
|
| | <div align="center"> |
| |
|
| | ### π Ready to Transform Ideas into 3D Reality? |
| |
|
| | ```batch |
| | 6-START_AIEXX.bat |
| | ``` |
| |
|
| | **[β¬ Back to Top](#aiexx-genai-image-to-3d)** |
| |
|
| | --- |
| |
|
| | **Built with β€οΈ by [AIEXX](https://github.com/AIExxplorer)** |
| |
|
| | **Optimized for NVIDIA RTX 5060 | Powered by AI** |
| |
|
| |  |
| |
|
| | </div> |