Update org card: +4 ros_action rSkills (MoveIt/Nav2), +2 OmDet detectors; rSkill count 31→30, breakdown 20 VLA / 4 ros_action / 5 detector / 1 vlm
Browse files- index.html +45 -4
index.html
CHANGED
|
@@ -219,7 +219,7 @@
|
|
| 219 |
<span class="badge">Apache-2.0</span>
|
| 220 |
<span class="badge">ROS 2 Jazzy</span>
|
| 221 |
<span class="badge">Python 3.12</span>
|
| 222 |
-
<span class="badge">16 robots ·
|
| 223 |
</div>
|
| 224 |
|
| 225 |
<!-- What is it -->
|
|
@@ -309,8 +309,9 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
|
|
| 309 |
<table>
|
| 310 |
<thead><tr><th>Type</th><th>What</th><th>Count</th></tr></thead>
|
| 311 |
<tbody>
|
| 312 |
-
<tr><td><code>rskill-*</code> models</td><td>
|
| 313 |
-
<tr><td><code>rskill-*</code> models</td><td>
|
|
|
|
| 314 |
<tr><td><code>rskill-*</code> models</td><td>Scene-understanding VLM rSkill (<code>kind: vlm</code>) — drives the reasoner's read-only <code>query_scene</code> tool</td><td>1</td></tr>
|
| 315 |
<tr><td><code>dataset-*</code></td><td>LeRobotDataset v3 demonstration datasets</td><td>growing</td></tr>
|
| 316 |
</tbody>
|
|
@@ -319,7 +320,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
|
|
| 319 |
|
| 320 |
<!-- rSkills -->
|
| 321 |
<h2>Policy rSkills</h2>
|
| 322 |
-
<p>Each rSkill is a self-contained Hub repo: <code>rskill.yaml</code> manifest, <code>model.safetensors</code> weights, <code>eval/</code> results, and a model card with runnable examples. Install with <code>openral rskill install OpenRAL/rskill-<name></code>. The table below shows a representative subset of the
|
| 323 |
|
| 324 |
<div class="table-wrap">
|
| 325 |
<table>
|
|
@@ -424,6 +425,36 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
|
|
| 424 |
</table>
|
| 425 |
</div>
|
| 426 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 427 |
<h2>Perception detector rSkills</h2>
|
| 428 |
<p><code>kind: detector</code> — emit <code>ObjectsMetadata</code> (2D detections lifted to 3D via depth) rather than an <code>Action</code>. Plug directly into the <code>openral deploy</code> graph and fold into World State.</p>
|
| 429 |
<div class="table-wrap">
|
|
@@ -440,6 +471,16 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
|
|
| 440 |
<td>RT-DETR v2 R50vd</td><td>Higher accuracy</td>
|
| 441 |
<td><span class="lic lic-green"></span>Apache-2.0</td>
|
| 442 |
</tr>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 443 |
<tr>
|
| 444 |
<td><code>rskill-locateanything-3b-nf4</code></td>
|
| 445 |
<td>LocateAnything-3B</td><td>Open vocabulary (out-of-process NF4 sidecar)</td>
|
|
|
|
| 219 |
<span class="badge">Apache-2.0</span>
|
| 220 |
<span class="badge">ROS 2 Jazzy</span>
|
| 221 |
<span class="badge">Python 3.12</span>
|
| 222 |
+
<span class="badge">16 robots · 30 rSkills · 22 benchmarks</span>
|
| 223 |
</div>
|
| 224 |
|
| 225 |
<!-- What is it -->
|
|
|
|
| 309 |
<table>
|
| 310 |
<thead><tr><th>Type</th><th>What</th><th>Count</th></tr></thead>
|
| 311 |
<tbody>
|
| 312 |
+
<tr><td><code>rskill-*</code> models</td><td>VLA policy rSkills — VLA weights + ROS-wrapped action skill + manifest + eval</td><td>20</td></tr>
|
| 313 |
+
<tr><td><code>rskill-*</code> models</td><td>ROS-action rSkills (<code>kind: ros_action</code>) — classical motion planners (MoveIt MoveGroup, Nav2) the reasoner dispatches like any other skill</td><td>4</td></tr>
|
| 314 |
+
<tr><td><code>rskill-*</code> models</td><td>Perception detector rSkills (<code>kind: detector</code>) — RT-DETR + OmDet-Turbo + LocateAnything → <code>ObjectsMetadata</code></td><td>5</td></tr>
|
| 315 |
<tr><td><code>rskill-*</code> models</td><td>Scene-understanding VLM rSkill (<code>kind: vlm</code>) — drives the reasoner's read-only <code>query_scene</code> tool</td><td>1</td></tr>
|
| 316 |
<tr><td><code>dataset-*</code></td><td>LeRobotDataset v3 demonstration datasets</td><td>growing</td></tr>
|
| 317 |
</tbody>
|
|
|
|
| 320 |
|
| 321 |
<!-- rSkills -->
|
| 322 |
<h2>Policy rSkills</h2>
|
| 323 |
+
<p>Each rSkill is a self-contained Hub repo: <code>rskill.yaml</code> manifest, <code>model.safetensors</code> weights, <code>eval/</code> results, and a model card with runnable examples. Install with <code>openral rskill install OpenRAL/rskill-<name></code>. The table below shows a representative subset of the 20 VLA policy rSkills; classical motion planners ship as separate <code>ros_action</code> rSkills (see below).</p>
|
| 324 |
|
| 325 |
<div class="table-wrap">
|
| 326 |
<table>
|
|
|
|
| 425 |
</table>
|
| 426 |
</div>
|
| 427 |
|
| 428 |
+
<h2>ROS-action rSkills</h2>
|
| 429 |
+
<p><code>kind: ros_action</code> — classical motion planners packaged as rSkills, so the S2 reasoner dispatches a MoveIt or Nav2 motion exactly like a learned policy (this is the "VLA <em>and</em> classical controllers" thesis). No weights; they wrap a ROS 2 action server.</p>
|
| 430 |
+
<div class="table-wrap">
|
| 431 |
+
<table>
|
| 432 |
+
<thead><tr><th>rSkill</th><th>Planner</th><th>What it does</th><th>License</th></tr></thead>
|
| 433 |
+
<tbody>
|
| 434 |
+
<tr>
|
| 435 |
+
<td><code>rskill-moveit-eef-pose</code></td>
|
| 436 |
+
<td>MoveIt MoveGroup</td><td>Collision-free motion to a 6-DOF Cartesian end-effector pose (e.g. a pre-grasp)</td>
|
| 437 |
+
<td><span class="lic lic-green"></span>Apache-2.0</td>
|
| 438 |
+
</tr>
|
| 439 |
+
<tr>
|
| 440 |
+
<td><code>rskill-moveit-joints</code></td>
|
| 441 |
+
<td>MoveIt MoveGroup</td><td>Collision-free motion to a target joint configuration (e.g. a policy's in-distribution start pose)</td>
|
| 442 |
+
<td><span class="lic lic-green"></span>Apache-2.0</td>
|
| 443 |
+
</tr>
|
| 444 |
+
<tr>
|
| 445 |
+
<td><code>rskill-moveit-look-at</code></td>
|
| 446 |
+
<td>MoveIt MoveGroup</td><td>Aim a wrist-mounted camera at a 3-D point so a later perception query / grasp sees the object framed</td>
|
| 447 |
+
<td><span class="lic lic-green"></span>Apache-2.0</td>
|
| 448 |
+
</tr>
|
| 449 |
+
<tr>
|
| 450 |
+
<td><code>rskill-nav2-navigate-to-pose</code></td>
|
| 451 |
+
<td>Nav2 NavigateToPose</td><td>Drive a mobile base to an absolute (<code>map</code>) or relative (<code>base_link</code>) goal pose</td>
|
| 452 |
+
<td><span class="lic lic-green"></span>Apache-2.0</td>
|
| 453 |
+
</tr>
|
| 454 |
+
</tbody>
|
| 455 |
+
</table>
|
| 456 |
+
</div>
|
| 457 |
+
|
| 458 |
<h2>Perception detector rSkills</h2>
|
| 459 |
<p><code>kind: detector</code> — emit <code>ObjectsMetadata</code> (2D detections lifted to 3D via depth) rather than an <code>Action</code>. Plug directly into the <code>openral deploy</code> graph and fold into World State.</p>
|
| 460 |
<div class="table-wrap">
|
|
|
|
| 471 |
<td>RT-DETR v2 R50vd</td><td>Higher accuracy</td>
|
| 472 |
<td><span class="lic lic-green"></span>Apache-2.0</td>
|
| 473 |
</tr>
|
| 474 |
+
<tr>
|
| 475 |
+
<td><code>rskill-omdet-turbo-indoor</code></td>
|
| 476 |
+
<td>OmDet-Turbo (Swin-tiny)</td><td>Real-time open-vocab; ~230-class indoor vocabulary, unprompted background producer</td>
|
| 477 |
+
<td><span class="lic lic-green"></span>Apache-2.0</td>
|
| 478 |
+
</tr>
|
| 479 |
+
<tr>
|
| 480 |
+
<td><code>rskill-omdet-turbo-locator</code></td>
|
| 481 |
+
<td>OmDet-Turbo (Swin-tiny)</td><td>On-demand <code>locate_in_view</code> — lightweight in-process "find X"</td>
|
| 482 |
+
<td><span class="lic lic-green"></span>Apache-2.0</td>
|
| 483 |
+
</tr>
|
| 484 |
<tr>
|
| 485 |
<td><code>rskill-locateanything-3b-nf4</code></td>
|
| 486 |
<td>LocateAnything-3B</td><td>Open vocabulary (out-of-process NF4 sidecar)</td>
|