tomrikert commited on
Commit ·
ef42dd2
1
Parent(s): f6b8708
Add prominent simulator support documentation
Browse files- No robot required! ClawBody works with MuJoCo simulator
- Updated README with simulator quick start guide
- Updated landing page with simulator callout section
- Updated SKILL.md with simulator instructions
- Added simulation/mujoco tags for discoverability
This makes ClawBody accessible to everyone, even without
physical Reachy Mini hardware.
- README.md +92 -36
- index.html +65 -28
- openclaw-skill/SKILL.md +20 -3
- style.css +17 -0
README.md
CHANGED
|
@@ -23,6 +23,8 @@ tags:
|
|
| 23 |
- multimodal
|
| 24 |
- vision
|
| 25 |
- expressive-robot
|
|
|
|
|
|
|
| 26 |
---
|
| 27 |
|
| 28 |
# 🦞🤖 ClawBody
|
|
@@ -34,6 +36,29 @@ ClawBody combines OpenClaw's AI intelligence with Reachy Mini's expressive robot
|
|
| 34 |
[](LICENSE)
|
| 35 |
[](https://www.python.org/downloads/)
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
## ✨ Features
|
| 38 |
|
| 39 |
- **🎤 Real-time Voice Conversation**: OpenAI Realtime API for sub-second response latency
|
|
@@ -41,6 +66,7 @@ ClawBody combines OpenClaw's AI intelligence with Reachy Mini's expressive robot
|
|
| 41 |
- **👀 Vision**: See through the robot's camera and describe the environment
|
| 42 |
- **💃 Expressive Movements**: Natural head movements, emotions, dances, and audio-driven wobble
|
| 43 |
- **🦞 Clawson Embodied**: Your friendly space lobster AI assistant, now with a body!
|
|
|
|
| 44 |
|
| 45 |
## 🏗️ Architecture
|
| 46 |
|
|
@@ -51,7 +77,7 @@ ClawBody combines OpenClaw's AI intelligence with Reachy Mini's expressive robot
|
|
| 51 |
│
|
| 52 |
▼
|
| 53 |
┌─────────────────────────────────────────────────────────────────┐
|
| 54 |
-
│
|
| 55 |
│ ┌─────────────┐ ┌─────────────┐ ┌─────────────────────────┐ │
|
| 56 |
│ │ Microphone │ │ Camera │ │ Movement System │ │
|
| 57 |
│ │ (input) │ │ (vision) │ │ (head, antennas, body) │ │
|
|
@@ -86,10 +112,15 @@ ClawBody combines OpenClaw's AI intelligence with Reachy Mini's expressive robot
|
|
| 86 |
|
| 87 |
## 📋 Prerequisites
|
| 88 |
|
| 89 |
-
###
|
| 90 |
- [Reachy Mini](https://www.pollen-robotics.com/reachy-mini/) robot (Wireless or Lite)
|
| 91 |
|
| 92 |
-
###
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 93 |
- Python 3.11+
|
| 94 |
- [Reachy Mini SDK](https://github.com/pollen-robotics/reachy_mini) installed
|
| 95 |
- [OpenClaw](https://github.com/openclaw/openclaw) gateway running
|
|
@@ -97,33 +128,44 @@ ClawBody combines OpenClaw's AI intelligence with Reachy Mini's expressive robot
|
|
| 97 |
|
| 98 |
## 🚀 Installation
|
| 99 |
|
| 100 |
-
###
|
| 101 |
|
| 102 |
```bash
|
| 103 |
-
#
|
| 104 |
-
|
| 105 |
-
|
| 106 |
-
# Clone the repository
|
| 107 |
-
git clone https://github.com/yourusername/clawbody.git
|
| 108 |
cd clawbody
|
| 109 |
|
| 110 |
-
#
|
| 111 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 112 |
```
|
| 113 |
|
| 114 |
-
###
|
| 115 |
|
| 116 |
```bash
|
|
|
|
|
|
|
|
|
|
| 117 |
# Clone the repository
|
| 118 |
-
git clone https://github.com/
|
| 119 |
cd clawbody
|
| 120 |
|
| 121 |
-
#
|
| 122 |
-
|
| 123 |
-
source .venv/bin/activate
|
| 124 |
-
|
| 125 |
-
# Install
|
| 126 |
-
pip install -e .
|
| 127 |
```
|
| 128 |
|
| 129 |
## ⚙️ Configuration
|
|
@@ -141,7 +183,7 @@ cp .env.example .env
|
|
| 141 |
OPENAI_API_KEY=sk-...your-key...
|
| 142 |
|
| 143 |
# OpenClaw Gateway (required for AI responses)
|
| 144 |
-
OPENCLAW_GATEWAY_URL=http://your
|
| 145 |
OPENCLAW_TOKEN=your-gateway-token
|
| 146 |
OPENCLAW_AGENT_ID=main
|
| 147 |
|
|
@@ -151,7 +193,19 @@ OPENAI_VOICE=cedar
|
|
| 151 |
|
| 152 |
## 🎮 Usage
|
| 153 |
|
| 154 |
-
###
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 155 |
|
| 156 |
```bash
|
| 157 |
# Basic usage
|
|
@@ -164,19 +218,6 @@ clawbody --debug
|
|
| 164 |
clawbody --robot-name my-reachy
|
| 165 |
```
|
| 166 |
|
| 167 |
-
### Web UI Mode
|
| 168 |
-
|
| 169 |
-
```bash
|
| 170 |
-
# Launch Gradio interface
|
| 171 |
-
clawbody --gradio
|
| 172 |
-
```
|
| 173 |
-
|
| 174 |
-
Then open http://localhost:7860 in your browser.
|
| 175 |
-
|
| 176 |
-
### As a Reachy Mini App
|
| 177 |
-
|
| 178 |
-
ClawBody registers as a Reachy Mini App, so you can launch it from the robot's dashboard after installation.
|
| 179 |
-
|
| 180 |
### CLI Options
|
| 181 |
|
| 182 |
| Option | Description |
|
|
@@ -201,6 +242,20 @@ ClawBody gives Clawson these physical abilities:
|
|
| 201 |
| **Speak** | Voice output through the robot's speaker |
|
| 202 |
| **Listen** | Hear through the robot's microphone |
|
| 203 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 204 |
## 📄 License
|
| 205 |
|
| 206 |
This project is licensed under the Apache 2.0 License - see the [LICENSE](LICENSE) file for details.
|
|
@@ -209,15 +264,16 @@ This project is licensed under the Apache 2.0 License - see the [LICENSE](LICENS
|
|
| 209 |
|
| 210 |
ClawBody builds on:
|
| 211 |
|
| 212 |
-
- [Pollen Robotics](https://www.pollen-robotics.com/) - Reachy Mini robot and
|
| 213 |
- [OpenClaw](https://github.com/openclaw/openclaw) - AI assistant framework (Clawson!)
|
| 214 |
- [OpenAI](https://openai.com/) - Realtime API for voice I/O
|
|
|
|
| 215 |
- [pollen-robotics/reachy_mini_conversation_app](https://huggingface.co/spaces/pollen-robotics/reachy_mini_conversation_app) - Movement and audio systems
|
| 216 |
|
| 217 |
## 🤝 Contributing
|
| 218 |
|
| 219 |
Contributions are welcome! Please feel free to submit a Pull Request.
|
| 220 |
|
| 221 |
-
- **This project**: [GitHub Issues](https://github.com/
|
| 222 |
- **OpenClaw Skills**: Submit ClawBody as a skill to [ClawHub](https://docs.openclaw.ai/tools/clawhub)
|
| 223 |
- **Reachy Mini Apps**: Submit to [Pollen Robotics](https://github.com/pollen-robotics)
|
|
|
|
| 23 |
- multimodal
|
| 24 |
- vision
|
| 25 |
- expressive-robot
|
| 26 |
+
- simulation
|
| 27 |
+
- mujoco
|
| 28 |
---
|
| 29 |
|
| 30 |
# 🦞🤖 ClawBody
|
|
|
|
| 36 |
[](LICENSE)
|
| 37 |
[](https://www.python.org/downloads/)
|
| 38 |
|
| 39 |
+
---
|
| 40 |
+
|
| 41 |
+
## 🎮 No Robot? No Problem!
|
| 42 |
+
|
| 43 |
+
**You don't need a physical Reachy Mini robot to use ClawBody!**
|
| 44 |
+
|
| 45 |
+
ClawBody works with the [Reachy Mini Simulator](https://huggingface.co/docs/reachy_mini/platforms/simulation/get_started), a MuJoCo-based physics simulation that runs on your computer. Watch Clawson move and express emotions on screen while you talk to your OpenClaw agent.
|
| 46 |
+
|
| 47 |
+
```bash
|
| 48 |
+
# Install simulator support
|
| 49 |
+
pip install "reachy-mini[mujoco]"
|
| 50 |
+
|
| 51 |
+
# Start the simulator (opens a 3D window)
|
| 52 |
+
reachy-mini-daemon --sim
|
| 53 |
+
|
| 54 |
+
# In another terminal, run ClawBody
|
| 55 |
+
clawbody --gradio
|
| 56 |
+
```
|
| 57 |
+
|
| 58 |
+
> 🍎 **Mac Users**: Use `mjpython -m reachy_mini.daemon.app.main --sim` instead.
|
| 59 |
+
|
| 60 |
+
---
|
| 61 |
+
|
| 62 |
## ✨ Features
|
| 63 |
|
| 64 |
- **🎤 Real-time Voice Conversation**: OpenAI Realtime API for sub-second response latency
|
|
|
|
| 66 |
- **👀 Vision**: See through the robot's camera and describe the environment
|
| 67 |
- **💃 Expressive Movements**: Natural head movements, emotions, dances, and audio-driven wobble
|
| 68 |
- **🦞 Clawson Embodied**: Your friendly space lobster AI assistant, now with a body!
|
| 69 |
+
- **🖥️ Simulator Support**: Works with or without physical hardware
|
| 70 |
|
| 71 |
## 🏗️ Architecture
|
| 72 |
|
|
|
|
| 77 |
│
|
| 78 |
▼
|
| 79 |
┌─────────────────────────────────────────────────────────────────┐
|
| 80 |
+
│ Reachy Mini Robot (or Simulator) │
|
| 81 |
│ ┌─────────────┐ ┌─────────────┐ ┌─────────────────────────┐ │
|
| 82 |
│ │ Microphone │ │ Camera │ │ Movement System │ │
|
| 83 |
│ │ (input) │ │ (vision) │ │ (head, antennas, body) │ │
|
|
|
|
| 112 |
|
| 113 |
## 📋 Prerequisites
|
| 114 |
|
| 115 |
+
### Option A: With Physical Robot
|
| 116 |
- [Reachy Mini](https://www.pollen-robotics.com/reachy-mini/) robot (Wireless or Lite)
|
| 117 |
|
| 118 |
+
### Option B: With Simulator (No Hardware Required!)
|
| 119 |
+
- Any computer with Python 3.11+
|
| 120 |
+
- Install: `pip install "reachy-mini[mujoco]"`
|
| 121 |
+
- [Simulation Setup Guide](https://huggingface.co/docs/reachy_mini/platforms/simulation/get_started)
|
| 122 |
+
|
| 123 |
+
### Software (Both Options)
|
| 124 |
- Python 3.11+
|
| 125 |
- [Reachy Mini SDK](https://github.com/pollen-robotics/reachy_mini) installed
|
| 126 |
- [OpenClaw](https://github.com/openclaw/openclaw) gateway running
|
|
|
|
| 128 |
|
| 129 |
## 🚀 Installation
|
| 130 |
|
| 131 |
+
### Quick Start with Simulator
|
| 132 |
|
| 133 |
```bash
|
| 134 |
+
# Clone ClawBody
|
| 135 |
+
git clone https://github.com/tomrikert/clawbody
|
|
|
|
|
|
|
|
|
|
| 136 |
cd clawbody
|
| 137 |
|
| 138 |
+
# Create virtual environment
|
| 139 |
+
python -m venv .venv
|
| 140 |
+
source .venv/bin/activate
|
| 141 |
+
|
| 142 |
+
# Install ClawBody + simulator support
|
| 143 |
+
pip install -e .
|
| 144 |
+
pip install "reachy-mini[mujoco]"
|
| 145 |
+
|
| 146 |
+
# Configure (see Configuration section)
|
| 147 |
+
cp .env.example .env
|
| 148 |
+
# Edit .env with your keys
|
| 149 |
+
|
| 150 |
+
# Terminal 1: Start the simulator
|
| 151 |
+
reachy-mini-daemon --sim
|
| 152 |
+
|
| 153 |
+
# Terminal 2: Run ClawBody
|
| 154 |
+
clawbody --gradio
|
| 155 |
```
|
| 156 |
|
| 157 |
+
### On a Physical Reachy Mini Robot
|
| 158 |
|
| 159 |
```bash
|
| 160 |
+
# SSH into the robot
|
| 161 |
+
ssh pollen@reachy-mini.local
|
| 162 |
+
|
| 163 |
# Clone the repository
|
| 164 |
+
git clone https://github.com/tomrikert/clawbody
|
| 165 |
cd clawbody
|
| 166 |
|
| 167 |
+
# Install in the apps virtual environment
|
| 168 |
+
/venvs/apps_venv/bin/pip install -e .
|
|
|
|
|
|
|
|
|
|
|
|
|
| 169 |
```
|
| 170 |
|
| 171 |
## ⚙️ Configuration
|
|
|
|
| 183 |
OPENAI_API_KEY=sk-...your-key...
|
| 184 |
|
| 185 |
# OpenClaw Gateway (required for AI responses)
|
| 186 |
+
OPENCLAW_GATEWAY_URL=http://localhost:18789 # or your host IP
|
| 187 |
OPENCLAW_TOKEN=your-gateway-token
|
| 188 |
OPENCLAW_AGENT_ID=main
|
| 189 |
|
|
|
|
| 193 |
|
| 194 |
## 🎮 Usage
|
| 195 |
|
| 196 |
+
### With Simulator
|
| 197 |
+
|
| 198 |
+
```bash
|
| 199 |
+
# Terminal 1: Start simulator
|
| 200 |
+
reachy-mini-daemon --sim
|
| 201 |
+
|
| 202 |
+
# Terminal 2: Run ClawBody with web UI (recommended for simulator)
|
| 203 |
+
clawbody --gradio
|
| 204 |
+
```
|
| 205 |
+
|
| 206 |
+
The simulator opens a 3D window where you can watch the robot move. The Gradio web UI at http://localhost:7860 lets you interact via your browser's microphone.
|
| 207 |
+
|
| 208 |
+
### With Physical Robot
|
| 209 |
|
| 210 |
```bash
|
| 211 |
# Basic usage
|
|
|
|
| 218 |
clawbody --robot-name my-reachy
|
| 219 |
```
|
| 220 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 221 |
### CLI Options
|
| 222 |
|
| 223 |
| Option | Description |
|
|
|
|
| 242 |
| **Speak** | Voice output through the robot's speaker |
|
| 243 |
| **Listen** | Hear through the robot's microphone |
|
| 244 |
|
| 245 |
+
## 🖥️ Simulator Features
|
| 246 |
+
|
| 247 |
+
When running with the simulator:
|
| 248 |
+
|
| 249 |
+
- **3D Visualization**: Watch Clawson's movements in real-time
|
| 250 |
+
- **Scene Options**: Use `--scene minimal` to add objects (apple, duck, croissant)
|
| 251 |
+
- **Full SDK Compatibility**: The simulator behaves exactly like a real robot
|
| 252 |
+
- **Dashboard Access**: Visit http://localhost:8000 to see the robot dashboard
|
| 253 |
+
|
| 254 |
+
```bash
|
| 255 |
+
# Start simulator with objects on a table
|
| 256 |
+
reachy-mini-daemon --sim --scene minimal
|
| 257 |
+
```
|
| 258 |
+
|
| 259 |
## 📄 License
|
| 260 |
|
| 261 |
This project is licensed under the Apache 2.0 License - see the [LICENSE](LICENSE) file for details.
|
|
|
|
| 264 |
|
| 265 |
ClawBody builds on:
|
| 266 |
|
| 267 |
+
- [Pollen Robotics](https://www.pollen-robotics.com/) - Reachy Mini robot, SDK, and simulator
|
| 268 |
- [OpenClaw](https://github.com/openclaw/openclaw) - AI assistant framework (Clawson!)
|
| 269 |
- [OpenAI](https://openai.com/) - Realtime API for voice I/O
|
| 270 |
+
- [MuJoCo](https://mujoco.org/) - Physics simulation engine
|
| 271 |
- [pollen-robotics/reachy_mini_conversation_app](https://huggingface.co/spaces/pollen-robotics/reachy_mini_conversation_app) - Movement and audio systems
|
| 272 |
|
| 273 |
## 🤝 Contributing
|
| 274 |
|
| 275 |
Contributions are welcome! Please feel free to submit a Pull Request.
|
| 276 |
|
| 277 |
+
- **This project**: [GitHub Issues](https://github.com/tomrikert/clawbody/issues)
|
| 278 |
- **OpenClaw Skills**: Submit ClawBody as a skill to [ClawHub](https://docs.openclaw.ai/tools/clawhub)
|
| 279 |
- **Reachy Mini Apps**: Submit to [Pollen Robotics](https://github.com/pollen-robotics)
|
index.html
CHANGED
|
@@ -30,14 +30,14 @@
|
|
| 30 |
intelligent responses from OpenClaw, and expressive robot movements.
|
| 31 |
</p>
|
| 32 |
<div class="hero-actions">
|
| 33 |
-
<a href="#
|
| 34 |
-
<a href="#
|
| 35 |
</div>
|
| 36 |
<div class="hero-badges">
|
| 37 |
<span>🎙️ OpenAI Realtime</span>
|
| 38 |
<span>🦞 OpenClaw Gateway</span>
|
| 39 |
<span>💃 Expressive movement</span>
|
| 40 |
-
<span
|
| 41 |
</div>
|
| 42 |
</div>
|
| 43 |
<div class="hero-visual">
|
|
@@ -45,6 +45,7 @@
|
|
| 45 |
<div class="architecture-preview">
|
| 46 |
<pre>
|
| 47 |
You speak → Reachy Mini 🎤
|
|
|
|
| 48 |
↓
|
| 49 |
OpenAI Realtime API
|
| 50 |
(speech recognition + TTS)
|
|
@@ -55,12 +56,40 @@
|
|
| 55 |
Robot speaks & moves 🤖💃
|
| 56 |
</pre>
|
| 57 |
</div>
|
| 58 |
-
<p class="caption">
|
| 59 |
</div>
|
| 60 |
</div>
|
| 61 |
</div>
|
| 62 |
</section>
|
| 63 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 64 |
<section class="section" id="features">
|
| 65 |
<div class="section-header">
|
| 66 |
<h2>What's inside</h2>
|
|
@@ -90,9 +119,9 @@
|
|
| 90 |
<p>Audio-driven head wobble, emotions, dances, and natural movements while speaking.</p>
|
| 91 |
</div>
|
| 92 |
<div class="feature-card">
|
| 93 |
-
<div class="icon"
|
| 94 |
-
<h3>
|
| 95 |
-
<p>
|
| 96 |
</div>
|
| 97 |
<div class="feature-card">
|
| 98 |
<div class="icon">⚡</div>
|
|
@@ -108,26 +137,25 @@
|
|
| 108 |
<h3>How it works</h3>
|
| 109 |
<p class="story-text">From speech to response in under a second</p>
|
| 110 |
<ol class="story-list">
|
| 111 |
-
<li><span>🎤</span> Robot
|
| 112 |
-
<li><span>🔇</span> Voice Activity Detection identifies when you stop speaking
|
| 113 |
-
<li><span>📝</span> OpenAI Realtime transcribes your speech instantly
|
| 114 |
-
<li><span>🦞</span> OpenClaw processes your message with full AI capabilities
|
| 115 |
-
<li><span>🔊</span> OpenAI Realtime speaks the response naturally
|
| 116 |
-
<li><span>🤖</span> Robot moves expressively while speaking
|
| 117 |
</ol>
|
| 118 |
</div>
|
| 119 |
<div class="story-card secondary">
|
| 120 |
<h3>Prerequisites</h3>
|
| 121 |
-
<p class="story-text">
|
| 122 |
<div class="chips">
|
| 123 |
<span class="chip">🦞 OpenClaw Gateway</span>
|
| 124 |
<span class="chip">🔑 OpenAI API Key</span>
|
| 125 |
-
<span class="chip">🤖 Reachy Mini</span>
|
| 126 |
<span class="chip">🐍 Python 3.11+</span>
|
| 127 |
</div>
|
| 128 |
<p class="story-text" style="margin-top: 1rem;">
|
| 129 |
-
|
| 130 |
-
|
| 131 |
</p>
|
| 132 |
<a href="https://huggingface.co/spaces/tomrikert/clawbody/blob/main/README.md" class="btn ghost wide" style="margin-top: 1rem;">
|
| 133 |
View installation guide
|
|
@@ -139,25 +167,32 @@
|
|
| 139 |
<section class="section">
|
| 140 |
<div class="section-header">
|
| 141 |
<h2>Quick start</h2>
|
| 142 |
-
<p class="intro">Get ClawBody running
|
| 143 |
</div>
|
| 144 |
<div class="story-card">
|
| 145 |
<div class="architecture-preview">
|
| 146 |
<pre>
|
| 147 |
-
#
|
| 148 |
-
|
| 149 |
-
|
| 150 |
-
# Clone and install
|
| 151 |
-
git clone https://huggingface.co/spaces/tomrikert/clawbody
|
| 152 |
cd clawbody
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 153 |
pip install -e .
|
|
|
|
| 154 |
|
| 155 |
-
# Configure (edit with your OpenClaw
|
| 156 |
cp .env.example .env
|
| 157 |
nano .env
|
| 158 |
|
| 159 |
-
#
|
| 160 |
-
|
|
|
|
|
|
|
|
|
|
| 161 |
</pre>
|
| 162 |
</div>
|
| 163 |
</div>
|
|
@@ -166,8 +201,10 @@ clawbody
|
|
| 166 |
<footer class="footer">
|
| 167 |
<p>
|
| 168 |
ClawBody — giving OpenClaw a physical presence with Reachy Mini.<br>
|
| 169 |
-
|
| 170 |
-
<a href="https://github.com/
|
|
|
|
|
|
|
| 171 |
</p>
|
| 172 |
</footer>
|
| 173 |
|
|
|
|
| 30 |
intelligent responses from OpenClaw, and expressive robot movements.
|
| 31 |
</p>
|
| 32 |
<div class="hero-actions">
|
| 33 |
+
<a href="#simulator" class="btn primary">🖥️ Try with Simulator</a>
|
| 34 |
+
<a href="#features" class="btn ghost">See features</a>
|
| 35 |
</div>
|
| 36 |
<div class="hero-badges">
|
| 37 |
<span>🎙️ OpenAI Realtime</span>
|
| 38 |
<span>🦞 OpenClaw Gateway</span>
|
| 39 |
<span>💃 Expressive movement</span>
|
| 40 |
+
<span>🖥️ No robot required!</span>
|
| 41 |
</div>
|
| 42 |
</div>
|
| 43 |
<div class="hero-visual">
|
|
|
|
| 45 |
<div class="architecture-preview">
|
| 46 |
<pre>
|
| 47 |
You speak → Reachy Mini 🎤
|
| 48 |
+
(or Simulator 🖥️)
|
| 49 |
↓
|
| 50 |
OpenAI Realtime API
|
| 51 |
(speech recognition + TTS)
|
|
|
|
| 56 |
Robot speaks & moves 🤖💃
|
| 57 |
</pre>
|
| 58 |
</div>
|
| 59 |
+
<p class="caption">Works with physical robot OR MuJoCo simulator!</p>
|
| 60 |
</div>
|
| 61 |
</div>
|
| 62 |
</div>
|
| 63 |
</section>
|
| 64 |
|
| 65 |
+
<section class="section simulator-callout" id="simulator">
|
| 66 |
+
<div class="story-card highlight">
|
| 67 |
+
<h2>🖥️ No Robot? No Problem!</h2>
|
| 68 |
+
<p class="story-text" style="font-size: 1.1rem;">
|
| 69 |
+
<strong>You don't need a physical Reachy Mini robot to use ClawBody!</strong><br><br>
|
| 70 |
+
ClawBody works with the Reachy Mini Simulator, a MuJoCo-based physics simulation
|
| 71 |
+
that runs on your computer. Watch Clawson move and express emotions on screen
|
| 72 |
+
while you talk to your OpenClaw agent.
|
| 73 |
+
</p>
|
| 74 |
+
<div class="architecture-preview" style="margin: 1.5rem 0;">
|
| 75 |
+
<pre>
|
| 76 |
+
# Install simulator support
|
| 77 |
+
pip install "reachy-mini[mujoco]"
|
| 78 |
+
|
| 79 |
+
# Start the simulator (opens 3D window)
|
| 80 |
+
reachy-mini-daemon --sim
|
| 81 |
+
|
| 82 |
+
# In another terminal, run ClawBody
|
| 83 |
+
clawbody --gradio
|
| 84 |
+
</pre>
|
| 85 |
+
</div>
|
| 86 |
+
<p class="caption">🍎 Mac Users: Use <code>mjpython -m reachy_mini.daemon.app.main --sim</code> instead</p>
|
| 87 |
+
<a href="https://huggingface.co/docs/reachy_mini/platforms/simulation/get_started" class="btn primary" style="margin-top: 1rem;" target="_blank">
|
| 88 |
+
📚 Simulator Setup Guide
|
| 89 |
+
</a>
|
| 90 |
+
</div>
|
| 91 |
+
</section>
|
| 92 |
+
|
| 93 |
<section class="section" id="features">
|
| 94 |
<div class="section-header">
|
| 95 |
<h2>What's inside</h2>
|
|
|
|
| 119 |
<p>Audio-driven head wobble, emotions, dances, and natural movements while speaking.</p>
|
| 120 |
</div>
|
| 121 |
<div class="feature-card">
|
| 122 |
+
<div class="icon">🖥️</div>
|
| 123 |
+
<h3>Simulator support</h3>
|
| 124 |
+
<p>No robot? Run with MuJoCo simulator and watch Clawson move in a 3D window.</p>
|
| 125 |
</div>
|
| 126 |
<div class="feature-card">
|
| 127 |
<div class="icon">⚡</div>
|
|
|
|
| 137 |
<h3>How it works</h3>
|
| 138 |
<p class="story-text">From speech to response in under a second</p>
|
| 139 |
<ol class="story-list">
|
| 140 |
+
<li><span>🎤</span> Robot (or simulator) captures your voice</li>
|
| 141 |
+
<li><span>🔇</span> Voice Activity Detection identifies when you stop speaking</li>
|
| 142 |
+
<li><span>📝</span> OpenAI Realtime transcribes your speech instantly</li>
|
| 143 |
+
<li><span>🦞</span> OpenClaw processes your message with full AI capabilities</li>
|
| 144 |
+
<li><span>🔊</span> OpenAI Realtime speaks the response naturally</li>
|
| 145 |
+
<li><span>🤖</span> Robot moves expressively while speaking</li>
|
| 146 |
</ol>
|
| 147 |
</div>
|
| 148 |
<div class="story-card secondary">
|
| 149 |
<h3>Prerequisites</h3>
|
| 150 |
+
<p class="story-text">Choose your setup:</p>
|
| 151 |
<div class="chips">
|
| 152 |
<span class="chip">🦞 OpenClaw Gateway</span>
|
| 153 |
<span class="chip">🔑 OpenAI API Key</span>
|
|
|
|
| 154 |
<span class="chip">🐍 Python 3.11+</span>
|
| 155 |
</div>
|
| 156 |
<p class="story-text" style="margin-top: 1rem;">
|
| 157 |
+
<strong>Option A:</strong> 🤖 Physical Reachy Mini robot<br>
|
| 158 |
+
<strong>Option B:</strong> 🖥️ MuJoCo Simulator (free, no hardware!)
|
| 159 |
</p>
|
| 160 |
<a href="https://huggingface.co/spaces/tomrikert/clawbody/blob/main/README.md" class="btn ghost wide" style="margin-top: 1rem;">
|
| 161 |
View installation guide
|
|
|
|
| 167 |
<section class="section">
|
| 168 |
<div class="section-header">
|
| 169 |
<h2>Quick start</h2>
|
| 170 |
+
<p class="intro">Get ClawBody running with the simulator</p>
|
| 171 |
</div>
|
| 172 |
<div class="story-card">
|
| 173 |
<div class="architecture-preview">
|
| 174 |
<pre>
|
| 175 |
+
# Clone ClawBody
|
| 176 |
+
git clone https://github.com/tomrikert/clawbody
|
|
|
|
|
|
|
|
|
|
| 177 |
cd clawbody
|
| 178 |
+
|
| 179 |
+
# Create virtual environment
|
| 180 |
+
python -m venv .venv
|
| 181 |
+
source .venv/bin/activate
|
| 182 |
+
|
| 183 |
+
# Install ClawBody + simulator
|
| 184 |
pip install -e .
|
| 185 |
+
pip install "reachy-mini[mujoco]"
|
| 186 |
|
| 187 |
+
# Configure (edit with your OpenClaw URL and OpenAI key)
|
| 188 |
cp .env.example .env
|
| 189 |
nano .env
|
| 190 |
|
| 191 |
+
# Terminal 1: Start simulator
|
| 192 |
+
reachy-mini-daemon --sim
|
| 193 |
+
|
| 194 |
+
# Terminal 2: Run ClawBody
|
| 195 |
+
clawbody --gradio
|
| 196 |
</pre>
|
| 197 |
</div>
|
| 198 |
</div>
|
|
|
|
| 201 |
<footer class="footer">
|
| 202 |
<p>
|
| 203 |
ClawBody — giving OpenClaw a physical presence with Reachy Mini.<br>
|
| 204 |
+
<strong>Works with physical robot OR simulator!</strong><br><br>
|
| 205 |
+
Learn more about <a href="https://github.com/openclaw/openclaw">OpenClaw</a>,
|
| 206 |
+
<a href="https://github.com/pollen-robotics/reachy_mini">Reachy Mini</a>, and
|
| 207 |
+
<a href="https://huggingface.co/docs/reachy_mini/platforms/simulation/get_started">the Simulator</a>.
|
| 208 |
</p>
|
| 209 |
</footer>
|
| 210 |
|
openclaw-skill/SKILL.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
---
|
| 2 |
name: clawbody
|
| 3 |
-
description: Give your OpenClaw AI agent a physical robot body with Reachy Mini. Voice conversation via OpenAI Realtime API, vision
|
| 4 |
---
|
| 5 |
|
| 6 |
# ClawBody - Robot Body for OpenClaw
|
|
@@ -34,10 +34,15 @@ You speak → Reachy Mini 🎤
|
|
| 34 |
|
| 35 |
## Requirements
|
| 36 |
|
| 37 |
-
###
|
| 38 |
- [Reachy Mini](https://github.com/pollen-robotics/reachy_mini) robot (Wireless or Lite)
|
| 39 |
|
| 40 |
-
###
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
- Python 3.11+
|
| 42 |
- OpenAI API key with Realtime API access
|
| 43 |
- OpenClaw gateway running on your network
|
|
@@ -68,6 +73,18 @@ OPENCLAW_TOKEN=your-gateway-token
|
|
| 68 |
|
| 69 |
## Usage
|
| 70 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
```bash
|
| 72 |
# Run ClawBody
|
| 73 |
clawbody
|
|
|
|
| 1 |
---
|
| 2 |
name: clawbody
|
| 3 |
+
description: Give your OpenClaw AI agent a physical robot body with Reachy Mini. Works with physical robot OR simulator! Voice conversation via OpenAI Realtime API, vision, and expressive movements.
|
| 4 |
---
|
| 5 |
|
| 6 |
# ClawBody - Robot Body for OpenClaw
|
|
|
|
| 34 |
|
| 35 |
## Requirements
|
| 36 |
|
| 37 |
+
### Option A: Physical Robot
|
| 38 |
- [Reachy Mini](https://github.com/pollen-robotics/reachy_mini) robot (Wireless or Lite)
|
| 39 |
|
| 40 |
+
### Option B: Simulator (No Hardware Required!)
|
| 41 |
+
- Any computer with Python 3.11+
|
| 42 |
+
- Install: `pip install "reachy-mini[mujoco]"`
|
| 43 |
+
- [Simulator Setup Guide](https://huggingface.co/docs/reachy_mini/platforms/simulation/get_started)
|
| 44 |
+
|
| 45 |
+
### Software (Both Options)
|
| 46 |
- Python 3.11+
|
| 47 |
- OpenAI API key with Realtime API access
|
| 48 |
- OpenClaw gateway running on your network
|
|
|
|
| 73 |
|
| 74 |
## Usage
|
| 75 |
|
| 76 |
+
### With Simulator (No Robot Required)
|
| 77 |
+
|
| 78 |
+
```bash
|
| 79 |
+
# Terminal 1: Start simulator
|
| 80 |
+
reachy-mini-daemon --sim
|
| 81 |
+
|
| 82 |
+
# Terminal 2: Run ClawBody
|
| 83 |
+
clawbody --gradio
|
| 84 |
+
```
|
| 85 |
+
|
| 86 |
+
### With Physical Robot
|
| 87 |
+
|
| 88 |
```bash
|
| 89 |
# Run ClawBody
|
| 90 |
clawbody
|
style.css
CHANGED
|
@@ -317,6 +317,23 @@ a {
|
|
| 317 |
background: linear-gradient(145deg, rgba(155, 89, 182, 0.1), rgba(255, 107, 107, 0.08));
|
| 318 |
}
|
| 319 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 320 |
.story-card h3 {
|
| 321 |
margin-bottom: 0.8rem;
|
| 322 |
}
|
|
|
|
| 317 |
background: linear-gradient(145deg, rgba(155, 89, 182, 0.1), rgba(255, 107, 107, 0.08));
|
| 318 |
}
|
| 319 |
|
| 320 |
+
.story-card.highlight {
|
| 321 |
+
background: linear-gradient(145deg, rgba(46, 204, 113, 0.15), rgba(52, 152, 219, 0.1));
|
| 322 |
+
border-color: rgba(46, 204, 113, 0.3);
|
| 323 |
+
}
|
| 324 |
+
|
| 325 |
+
.simulator-callout {
|
| 326 |
+
padding-top: 0;
|
| 327 |
+
}
|
| 328 |
+
|
| 329 |
+
.simulator-callout code {
|
| 330 |
+
background: rgba(0, 0, 0, 0.3);
|
| 331 |
+
padding: 0.2rem 0.5rem;
|
| 332 |
+
border-radius: 4px;
|
| 333 |
+
font-family: "SF Mono", "Fira Code", monospace;
|
| 334 |
+
font-size: 0.85rem;
|
| 335 |
+
}
|
| 336 |
+
|
| 337 |
.story-card h3 {
|
| 338 |
margin-bottom: 0.8rem;
|
| 339 |
}
|