wkddbwld/SAM3D
0
🎨 Text to 3D – MCP Server
Generate and edit 3D models from text prompts using Gemini + Meta SAM-3D.
🎬 Demo: [YouTube Link] 📱 Post: [X/LinkedIn Link]
💡 Use Cases
This tool enables rapid 3D asset creation through natural language:
- Game Developers – Quickly prototype 3D assets by describing them ("a medieval sword", "a sci-fi helmet")
- Designers & Artists – Generate concept models and iterate with text edits ("make it larger", "change color to gold")
- E-commerce – Create product mockups from descriptions for visualization
- Education – Generate 3D models for teaching (anatomy, architecture, objects)
- AI Agents – Claude/Cursor can autonomously create 3D assets as part of larger workflows via MCP
🚀 Future Scope
- Multi-object scene generation
- Style transfer for 3D models
- Animation support
- Direct 3D file editing without regeneration
- Integration with game engines (Unity/Unreal)
🏗️ Architecture
┌─────────────────┐ MCP Protocol ┌─────────────────────┐
│ Claude Desktop │ ◄────────────────────► │ Gradio MCP Server │
│ Cursor / Cline │ │ (HF Space) │
└─────────────────┘ └──────────┬──────────┘
│
┌─────────────────────────────┼─────────────────────────────┐
▼ ▼ ▼
┌─────────────┐ ┌─────────────┐ ┌─────────────┐
│ Gemini │ │ Gemini │ │ SAM-3D │
│ Generate │──────────────│ Edit │──────────────│ (Modal) │
│ Image │ │ / Remove │ │ 3D Recon │
└─────────────┘ └─────────────┘ └─────────────┘Flow: Text → Image → Remove BG → Grayscale Mask → SAM-3D → 3D Model (GLB/PLY)
🔌 MCP Tools
Connect from Claude Desktop
{
"mcpServers": {
"text-to-3d": {
"command": "npx",
"args": ["mcp-remote", "https://MCP-1st-Birthday-text-to-3d-SAM3D.hf.space/gradio_api/mcp/sse"]
}
}
}🛠️ Tech Stack
📦 Outputs
- GLB – 3D mesh
- PLY – Gaussian splat
Built for [MCP 1st Birthday Hackathon](https://huggingface.co/MCP-1st-Birthday) 🎂