bhatanerohan commited on
Commit
d20f583
Β·
verified Β·
1 Parent(s): a03d9f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -24,6 +24,42 @@ Generate and edit 3D models from text prompts using **Gemini** + **Meta SAM-3D**
24
  🎬 **Demo:** [YouTube Link]
25
  πŸ“± **Post:** [X/LinkedIn Link]
26
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
  ## πŸ”Œ MCP Tools
28
 
29
  | Tool | Description |
 
24
  🎬 **Demo:** [YouTube Link]
25
  πŸ“± **Post:** [X/LinkedIn Link]
26
 
27
+ ## πŸ’‘ Use Cases
28
+
29
+ This tool enables rapid 3D asset creation through natural language:
30
+ - **Game Developers** – Quickly prototype 3D assets by describing them ("a medieval sword", "a sci-fi helmet")
31
+ - **Designers & Artists** – Generate concept models and iterate with text edits ("make it larger", "change color to gold")
32
+ - **E-commerce** – Create product mockups from descriptions for visualization
33
+ - **Education** – Generate 3D models for teaching (anatomy, architecture, objects)
34
+ - **AI Agents** – Claude/Cursor can autonomously create 3D assets as part of larger workflows via MCP
35
+
36
+ ## πŸš€ Future Scope
37
+
38
+ - Multi-object scene generation
39
+ - Style transfer for 3D models
40
+ - Animation support
41
+ - Direct 3D file editing without regeneration
42
+ - Integration with game engines (Unity/Unreal)
43
+
44
+ ## πŸ—οΈ Architecture
45
+
46
+ ```
47
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” MCP Protocol β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
48
+ β”‚ Claude Desktop β”‚ ◄────────────────────► β”‚ Gradio MCP Server β”‚
49
+ β”‚ Cursor / Cline β”‚ β”‚ (HF Space) β”‚
50
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
51
+ β”‚
52
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
53
+ β–Ό β–Ό β–Ό
54
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
55
+ β”‚ Gemini β”‚ β”‚ Gemini β”‚ β”‚ SAM-3D β”‚
56
+ β”‚ Generate │──────────────│ Edit │──────────────│ (Modal) β”‚
57
+ β”‚ Image β”‚ β”‚ / Remove β”‚ β”‚ 3D Recon β”‚
58
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
59
+ ```
60
+
61
+ **Flow:** `Text β†’ Image β†’ Remove BG β†’ Grayscale Mask β†’ SAM-3D β†’ 3D Model (GLB/PLY)`
62
+
63
  ## πŸ”Œ MCP Tools
64
 
65
  | Tool | Description |