--- license: gemma library_name: transformers base_model: - Dexmal/DM05 datasets: - Dexmal/robotwin2-full tags: - robotics - robot-control - vision-language-action - vla - dm05 - dm0.5 - robotwin - robotwin2 - opendm --- # DM05-robotwin2 
## Introduction DM05-robotwin2 is the RoboTwin 2.0 fine-tuned generalist checkpoint of DM0.5, Dexmal's open-world Vision-Language-Action foundation model for embodied intelligence. DM0.5 uses a Gemma3 4B vision-language backbone with a 680M Action Expert to generate continuous robot actions, and is designed for natural-language manipulation, zero-shot generalization, efficient downstream fine-tuning, long-horizon historical context, robust policy behavior, and transfer across robot embodiments. This checkpoint controls the ALOHA bimanual embodiment using three RGB camera views and generates 14-dimensional joint-position action chunks. #### RoboTwin 2.0 Results | Method | Clean | Randomized | Average | | --- | ---: | ---: | ---: | | DM0.5 | 93.6 | 93.3 | 93.5 | ## Quick Start We recommend using Docker to set up the runtime environment first, which helps avoid version mismatches across CUDA, PyTorch, flash-attn, and other dependencies on the host machine. ### Requirements ```text System requirements: Ubuntu 20.04 / 22.04 NVIDIA GPU NVIDIA Driver Docker NVIDIA Container Toolkit Conda (optional, only required for local pip installation) Recommended GPUs: A100, H100, H20 32 GPUs are recommended for training, and 1 GPU is sufficient for deployment inference. ``` ### Docker Installation ```bash git clone https://github.com/dexmal/opendm.git cd opendm docker run -it --rm --gpus all --network host \ --name opendm \ --shm-size=16g \ -v "$PWD":/app/opendm \ -w /app/opendm \ dexmal/opendm:latest /bin/bash # Run from the OpenDM repository root inside the container. conda activate opendm pip install -e . ``` ### Local Installation ```bash conda create -n opendm python=3.10 -y conda activate opendm pip install torch torchvision \ --index-url https://download.pytorch.org/whl/cu128 pip install ninja packaging MAX_JOBS=2 pip install flash-attn --no-build-isolation # Enter the OpenDM repository root. cd opendm pip install -e . ``` ## RoboTwin 2.0 Testing Use the RoboTwin 2.0-specific experiment configuration when evaluating this checkpoint. The inference service and benchmark client run separately and communicate over HTTP. When possible, use one GPU for the inference service and another for benchmark evaluation. For the complete data preparation, training, inference, and evaluation workflow, see the [DM05 RoboTwin 2.0 Training and Evaluation Guide](https://github.com/dexmal/opendm/blob/main/docs/en/dm05_robotwin2.md). ### Start the RoboTwin 2.0 Inference Service Run this command from the OpenDM repository root. The checkpoint must contain the matching `norm_stats.json`. ```bash script/dm05_launcher.sh \ --exp playground/dm05_robotwin2.py \ --task inference \ --nproc_per_node 1 \ --model-config.model-name-or-path ./checkpoints/DM05-robotwin2-bf16 \ --model-config.chunk-size 50 \ --inference-config.output-action-dim 14 \ --inference-config.image-keys images_1 images_2 images_3 \ --inference-config.port 7891 ``` Keep the service running while executing the benchmark. ### Prepare the Benchmark Client ```bash git clone https://github.com/dexmal/dexbotic-benchmark.git cd dexbotic-benchmark git submodule update --init --recursive RoboTwin docker pull dexmal/dexbotic_benchmark ``` RoboTwin 2.0 also requires its assets, object-data texture library, and embodiment files. Follow the [RoboTwin installation guide](https://robotwin-platform.github.io/doc/usage/robotwin-install.html#4-download-assets-robotwin-od-texture-library-and-embodiments) to download them before starting evaluation. Edit `evaluation/configs/robotwin2/adjust_bottle.yaml` so that `base_url` points to the inference service: ```yaml # Basic experiment configuration (keep unchanged) policy_name: dexbotic task_name: adjust_bottle task_config: demo_clean ckpt_setting: dexbotic seed: 0 instruction_type: seen # Add Parameters You Need base_url: http://localhost:7891 output_dir: ./result_test/robotwin2_evaluation cameras: "head_camera_rgb,left_camera_rgb,right_camera_rgb" action_horizon: 50 action_mode: absolute ``` Important configuration fields: - `task_name`: one of the 50 RoboTwin 2.0 tasks. Each task is evaluated independently. - `task_config`: use `demo_clean` for the Clean setting and `demo_randomized` for the Randomized setting. - `base_url`: address of the running DM0.5 inference service. For a remote service, use `http://