Safetensors
BaochangRen commited on
Commit
25eb952
·
verified ·
1 Parent(s): 91a6750

add model README

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md CHANGED
@@ -1,3 +1,50 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+ <div align="center">
5
+ <h1 align="center"> 🔬 LabVLA </h1>
6
+ <h3 align="center"> Grounding Vision–Language–Action Models in Scientific Laboratories </h3>
7
+
8
+ <p align="center">
9
+ <a href="https://zjunlp.github.io/LabVLA/">🔥Project Page</a> •
10
+ <a href="https://github.com/zjunlp/LabVLA">💻GitHub Repo</a> •
11
+ <a href="https://huggingface.co/zjunlp/LabVLA">🤗Model</a>
12
+ </p>
13
+ </div>
14
+
15
+ ---
16
+
17
+ ## Model Description
18
+
19
+ **LabVLA** is the first vision–language–action (VLA) model designed for scientific laboratory environments. It combines a **Qwen3-VL-4B** vision–language backbone with a **DiT flow-matching action expert**, trained with the π0.5 recipe to enable real-time robot control in lab settings.
20
+
21
+ The checkpoint is **self-contained** — loading requires no external base model. The bundled `vlm_config.json` allows the backbone to be rebuilt weightlessly, and `model.safetensors` provides all weights.
22
+
23
+ ## How to Use
24
+
25
+ ### Download
26
+
27
+ ```bash
28
+ huggingface-cli download zjunlp/LabVLA --local-dir LabVLA
29
+ ```
30
+
31
+ ### Deployment
32
+
33
+ Serve the model over the OpenPI msgpack WebSocket protocol:
34
+
35
+ ```bash
36
+ git clone https://github.com/zjunlp/LabVLA.git
37
+ cd LabVLA
38
+ bash deployment/deploy.sh
39
+ ```
40
+
41
+ ### Load in Python
42
+
43
+ ```python
44
+ import sys; sys.path.insert(0, "src")
45
+ from policies.LabVLA.modeling_labvla import LabVLAPolicy
46
+
47
+ policy = LabVLAPolicy.from_pretrained("zjunlp/LabVLA")
48
+ ```
49
+
50
+ For training, data preparation, and more details, please refer to our [GitHub repository](https://github.com/zjunlp/LabVLA).