Reinforcement Learning
Transformers
English
robotics
vla
vision-language-action
openvla
omnivla
robot
qwen
dinov2
siglip
Instructions to use theguy21/openvla-micro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use theguy21/openvla-micro with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("theguy21/openvla-micro", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Add launch script for robot pipeline
Browse files- run_micro.sh +32 -0
run_micro.sh
ADDED
|
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
#!/usr/bin/env bash
|
| 2 |
+
# Run OpenVLA-Micro on the Nova Carter diff-drive robot.
|
| 3 |
+
# Starts: Kinect driver → VLA inference → instruction CLI
|
| 4 |
+
set -e
|
| 5 |
+
|
| 6 |
+
SCRIPT_DIR="$(cd "$(dirname "$0")" && pwd)"
|
| 7 |
+
source /opt/ros/lyrical/setup.bash
|
| 8 |
+
|
| 9 |
+
# Kill existing pipeline
|
| 10 |
+
echo 1121 | sudo -S pkill -9 -f kinect_driver 2>/dev/null || true
|
| 11 |
+
echo 1121 | sudo -S pkill -9 -f vla_micro_ros2_node 2>/dev/null || true
|
| 12 |
+
echo 1121 | sudo -S pkill -9 -f vla_waypoint_follower 2>/dev/null || true
|
| 13 |
+
echo 1121 | sudo -S pkill -9 -f instruction_cli 2>/dev/null || true
|
| 14 |
+
echo 1121 | sudo -S pkill -9 -f freenect 2>/dev/null || true
|
| 15 |
+
sleep 2
|
| 16 |
+
|
| 17 |
+
echo "Starting OpenVLA-Micro pipeline..."
|
| 18 |
+
|
| 19 |
+
python3 /home/robotai/kinect_driver.py &
|
| 20 |
+
PID_KINECT=$!
|
| 21 |
+
sleep 3
|
| 22 |
+
|
| 23 |
+
python3 "$SCRIPT_DIR/vla_micro_ros2_node.py" &
|
| 24 |
+
PID_VLA=$!
|
| 25 |
+
sleep 5
|
| 26 |
+
|
| 27 |
+
python3 /home/robotai/instruction_cli.py &
|
| 28 |
+
PID_CLI=$!
|
| 29 |
+
|
| 30 |
+
trap "echo 1121 | sudo -S kill $PID_KINECT $PID_VLA $PID_CLI 2>/dev/null; echo Stopped" EXIT INT TERM
|
| 31 |
+
echo "All nodes running. Instructions via instruction_cli."
|
| 32 |
+
wait
|