AdrianLlopart commited on
Commit
952903b
·
verified ·
1 Parent(s): 078c3bd

Update org card: +4 ros_action rSkills (MoveIt/Nav2), +2 OmDet detectors; rSkill count 31→30, breakdown 20 VLA / 4 ros_action / 5 detector / 1 vlm

Browse files
Files changed (1) hide show
  1. index.html +45 -4
index.html CHANGED
@@ -219,7 +219,7 @@
219
  <span class="badge">Apache-2.0</span>
220
  <span class="badge">ROS 2 Jazzy</span>
221
  <span class="badge">Python 3.12</span>
222
- <span class="badge">16 robots · 31 rSkills · 22 benchmarks</span>
223
  </div>
224
 
225
  <!-- What is it -->
@@ -309,8 +309,9 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
309
  <table>
310
  <thead><tr><th>Type</th><th>What</th><th>Count</th></tr></thead>
311
  <tbody>
312
- <tr><td><code>rskill-*</code> models</td><td>Policy rSkills — VLA weights + ROS-wrapped action skills + manifest + eval</td><td>27</td></tr>
313
- <tr><td><code>rskill-*</code> models</td><td>Perception detector rSkills — RT-DETR + LocateAnything → <code>ObjectsMetadata</code></td><td>3</td></tr>
 
314
  <tr><td><code>rskill-*</code> models</td><td>Scene-understanding VLM rSkill (<code>kind: vlm</code>) — drives the reasoner's read-only <code>query_scene</code> tool</td><td>1</td></tr>
315
  <tr><td><code>dataset-*</code></td><td>LeRobotDataset v3 demonstration datasets</td><td>growing</td></tr>
316
  </tbody>
@@ -319,7 +320,7 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
319
 
320
  <!-- rSkills -->
321
  <h2>Policy rSkills</h2>
322
- <p>Each rSkill is a self-contained Hub repo: <code>rskill.yaml</code> manifest, <code>model.safetensors</code> weights, <code>eval/</code> results, and a model card with runnable examples. Install with <code>openral rskill install OpenRAL/rskill-&lt;name&gt;</code>. The table below shows a representative subset of the 27 policy rSkills (VLA + ROS-wrapped action skills).</p>
323
 
324
  <div class="table-wrap">
325
  <table>
@@ -424,6 +425,36 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
424
  </table>
425
  </div>
426
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
427
  <h2>Perception detector rSkills</h2>
428
  <p><code>kind: detector</code> — emit <code>ObjectsMetadata</code> (2D detections lifted to 3D via depth) rather than an <code>Action</code>. Plug directly into the <code>openral deploy</code> graph and fold into World State.</p>
429
  <div class="table-wrap">
@@ -440,6 +471,16 @@ openral deploy run --config deployments/so100_pickplace.yaml</code></pre>
440
  <td>RT-DETR v2 R50vd</td><td>Higher accuracy</td>
441
  <td><span class="lic lic-green"></span>Apache-2.0</td>
442
  </tr>
 
 
 
 
 
 
 
 
 
 
443
  <tr>
444
  <td><code>rskill-locateanything-3b-nf4</code></td>
445
  <td>LocateAnything-3B</td><td>Open vocabulary (out-of-process NF4 sidecar)</td>
 
219
  <span class="badge">Apache-2.0</span>
220
  <span class="badge">ROS 2 Jazzy</span>
221
  <span class="badge">Python 3.12</span>
222
+ <span class="badge">16 robots · 30 rSkills · 22 benchmarks</span>
223
  </div>
224
 
225
  <!-- What is it -->
 
309
  <table>
310
  <thead><tr><th>Type</th><th>What</th><th>Count</th></tr></thead>
311
  <tbody>
312
+ <tr><td><code>rskill-*</code> models</td><td>VLA policy rSkills — VLA weights + ROS-wrapped action skill + manifest + eval</td><td>20</td></tr>
313
+ <tr><td><code>rskill-*</code> models</td><td>ROS-action rSkills (<code>kind: ros_action</code>) — classical motion planners (MoveIt MoveGroup, Nav2) the reasoner dispatches like any other skill</td><td>4</td></tr>
314
+ <tr><td><code>rskill-*</code> models</td><td>Perception detector rSkills (<code>kind: detector</code>) — RT-DETR + OmDet-Turbo + LocateAnything → <code>ObjectsMetadata</code></td><td>5</td></tr>
315
  <tr><td><code>rskill-*</code> models</td><td>Scene-understanding VLM rSkill (<code>kind: vlm</code>) — drives the reasoner's read-only <code>query_scene</code> tool</td><td>1</td></tr>
316
  <tr><td><code>dataset-*</code></td><td>LeRobotDataset v3 demonstration datasets</td><td>growing</td></tr>
317
  </tbody>
 
320
 
321
  <!-- rSkills -->
322
  <h2>Policy rSkills</h2>
323
+ <p>Each rSkill is a self-contained Hub repo: <code>rskill.yaml</code> manifest, <code>model.safetensors</code> weights, <code>eval/</code> results, and a model card with runnable examples. Install with <code>openral rskill install OpenRAL/rskill-&lt;name&gt;</code>. The table below shows a representative subset of the 20 VLA policy rSkills; classical motion planners ship as separate <code>ros_action</code> rSkills (see below).</p>
324
 
325
  <div class="table-wrap">
326
  <table>
 
425
  </table>
426
  </div>
427
 
428
+ <h2>ROS-action rSkills</h2>
429
+ <p><code>kind: ros_action</code> — classical motion planners packaged as rSkills, so the S2 reasoner dispatches a MoveIt or Nav2 motion exactly like a learned policy (this is the "VLA <em>and</em> classical controllers" thesis). No weights; they wrap a ROS 2 action server.</p>
430
+ <div class="table-wrap">
431
+ <table>
432
+ <thead><tr><th>rSkill</th><th>Planner</th><th>What it does</th><th>License</th></tr></thead>
433
+ <tbody>
434
+ <tr>
435
+ <td><code>rskill-moveit-eef-pose</code></td>
436
+ <td>MoveIt MoveGroup</td><td>Collision-free motion to a 6-DOF Cartesian end-effector pose (e.g. a pre-grasp)</td>
437
+ <td><span class="lic lic-green"></span>Apache-2.0</td>
438
+ </tr>
439
+ <tr>
440
+ <td><code>rskill-moveit-joints</code></td>
441
+ <td>MoveIt MoveGroup</td><td>Collision-free motion to a target joint configuration (e.g. a policy's in-distribution start pose)</td>
442
+ <td><span class="lic lic-green"></span>Apache-2.0</td>
443
+ </tr>
444
+ <tr>
445
+ <td><code>rskill-moveit-look-at</code></td>
446
+ <td>MoveIt MoveGroup</td><td>Aim a wrist-mounted camera at a 3-D point so a later perception query / grasp sees the object framed</td>
447
+ <td><span class="lic lic-green"></span>Apache-2.0</td>
448
+ </tr>
449
+ <tr>
450
+ <td><code>rskill-nav2-navigate-to-pose</code></td>
451
+ <td>Nav2 NavigateToPose</td><td>Drive a mobile base to an absolute (<code>map</code>) or relative (<code>base_link</code>) goal pose</td>
452
+ <td><span class="lic lic-green"></span>Apache-2.0</td>
453
+ </tr>
454
+ </tbody>
455
+ </table>
456
+ </div>
457
+
458
  <h2>Perception detector rSkills</h2>
459
  <p><code>kind: detector</code> — emit <code>ObjectsMetadata</code> (2D detections lifted to 3D via depth) rather than an <code>Action</code>. Plug directly into the <code>openral deploy</code> graph and fold into World State.</p>
460
  <div class="table-wrap">
 
471
  <td>RT-DETR v2 R50vd</td><td>Higher accuracy</td>
472
  <td><span class="lic lic-green"></span>Apache-2.0</td>
473
  </tr>
474
+ <tr>
475
+ <td><code>rskill-omdet-turbo-indoor</code></td>
476
+ <td>OmDet-Turbo (Swin-tiny)</td><td>Real-time open-vocab; ~230-class indoor vocabulary, unprompted background producer</td>
477
+ <td><span class="lic lic-green"></span>Apache-2.0</td>
478
+ </tr>
479
+ <tr>
480
+ <td><code>rskill-omdet-turbo-locator</code></td>
481
+ <td>OmDet-Turbo (Swin-tiny)</td><td>On-demand <code>locate_in_view</code> — lightweight in-process "find X"</td>
482
+ <td><span class="lic lic-green"></span>Apache-2.0</td>
483
+ </tr>
484
  <tr>
485
  <td><code>rskill-locateanything-3b-nf4</code></td>
486
  <td>LocateAnything-3B</td><td>Open vocabulary (out-of-process NF4 sidecar)</td>