INCEPTIONwang commited on
Commit
1cec433
·
1 Parent(s): 8b13430

docs: expand PolicyTrim model card

Browse files
Files changed (1) hide show
  1. README.md +136 -0
README.md CHANGED
@@ -1,3 +1,139 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ language:
4
+ - en
5
+ library_name: pytorch
6
+ tags:
7
+ - robotics
8
+ - vision-language-action
9
+ - reinforcement-learning
10
+ - grpo
11
+ - policy-efficiency
12
+ - embodied-ai
13
+ - libero
14
+ - maniskill
15
+ - metaworld
16
+ - openpi
17
+ - openvla
18
+ arxiv: 2606.22540
19
  ---
20
+
21
+ <div align="center">
22
+
23
+ # PolicyTrim
24
+
25
+ ### Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models
26
+
27
+ [![Paper](https://img.shields.io/badge/arXiv-2606.22540-b31b1b.svg)](https://arxiv.org/abs/2606.22540)
28
+ [![GitHub](https://img.shields.io/badge/GitHub-PolicyTrim-181717.svg?logo=github)](https://github.com/INCEPTIONwang/PolicyTrim)
29
+ [![Project Page](https://img.shields.io/badge/Project-Page-2563eb.svg)](https://inceptionwang.github.io/PolicyTrim/)
30
+ [![Hugging Face Paper](https://img.shields.io/badge/Hugging%20Face-Paper-ffcc4d.svg)](https://huggingface.co/papers/2606.22540)
31
+ [![License](https://img.shields.io/badge/License-Apache--2.0-green.svg)](https://github.com/INCEPTIONwang/PolicyTrim/blob/main/LICENSE)
32
+
33
+ **Xianghui Wang\***, **Feng Chen\***, Wenbo Zhang, Hua Yan, Zixuan Wang<sup>†</sup>, Changsheng Li, Yinjie Lei<sup>‡</sup>
34
+
35
+ <sup>*</sup> Equal contribution · <sup>†</sup> Project lead · <sup>‡</sup> Corresponding author
36
+
37
+ </div>
38
+
39
+ ## Model Card
40
+
41
+ This repository provides the released post-training actor checkpoints for
42
+ **PolicyTrim**, a two-stage reinforcement learning framework for improving the
43
+ intrinsic policy efficiency of Vision-Language-Action (VLA) models.
44
+
45
+ Most deployment-efficiency methods reduce the latency of each model forward
46
+ pass. PolicyTrim instead reduces how many inference calls and physical actions
47
+ are required to finish a task. It targets two policy-level bottlenecks:
48
+
49
+ 1. unreliable predictions near the tail of an action chunk;
50
+ 2. redundant physical execution steps and corrective actions.
51
+
52
+ PolicyTrim first extends the reliable executable action horizon, then applies a
53
+ redundancy-aware step-saving objective with stability regularization. Across
54
+ three benchmarks and three VLA model families, the method reports:
55
+
56
+ - **3x** improvement in action chunk utilization;
57
+ - **51.4%** reduction in physical execution steps;
58
+ - up to **5.83x** end-to-end deployment speedup;
59
+ - no compromise in task success rates.
60
+
61
+ For the method, training code, configuration files, and evaluation scripts, see
62
+ the [PolicyTrim GitHub repository](https://github.com/INCEPTIONwang/PolicyTrim).
63
+
64
+ <div align="center">
65
+ <img src="https://raw.githubusercontent.com/INCEPTIONwang/PolicyTrim/main/overview_01.png" alt="PolicyTrim overview" width="100%"/>
66
+ </div>
67
+
68
+ ## Resources
69
+
70
+ - **Paper:** [arXiv:2606.22540](https://arxiv.org/abs/2606.22540)
71
+ - **PDF:** [PolicyTrim paper](https://arxiv.org/pdf/2606.22540)
72
+ - **Project page:** [inceptionwang.github.io/PolicyTrim](https://inceptionwang.github.io/PolicyTrim/)
73
+ - **Code:** [github.com/INCEPTIONwang/PolicyTrim](https://github.com/INCEPTIONwang/PolicyTrim)
74
+ - **Hugging Face paper page:** [huggingface.co/papers/2606.22540](https://huggingface.co/papers/2606.22540)
75
+
76
+ ## Download
77
+
78
+ Install the Hugging Face Hub CLI:
79
+
80
+ ```bash
81
+ pip install -U huggingface_hub
82
+ ```
83
+
84
+ Download the complete repository:
85
+
86
+ ```bash
87
+ hf download INCEPTIONwang/PolicyTrim \
88
+ --local-dir ./PolicyTrim-checkpoints
89
+ ```
90
+
91
+ The complete repository is large. To download only one checkpoint, specify its
92
+ path. For example:
93
+
94
+ ```bash
95
+ hf download INCEPTIONwang/PolicyTrim \
96
+ libero_goal_grpo_openpi_pi05/checkpoints/global_step_500/actor/model_state_dict/full_weights.pt \
97
+ --local-dir ./PolicyTrim-checkpoints
98
+ ```
99
+
100
+ Python equivalent:
101
+
102
+ ```python
103
+ from huggingface_hub import hf_hub_download
104
+
105
+ checkpoint_path = hf_hub_download(
106
+ repo_id="INCEPTIONwang/PolicyTrim",
107
+ filename=(
108
+ "libero_goal_grpo_openpi_pi05/checkpoints/global_step_500/"
109
+ "actor/model_state_dict/full_weights.pt"
110
+ ),
111
+ )
112
+ ```
113
+
114
+ ## Loading and Evaluation
115
+
116
+ Checkpoint restoration depends on the matching VLA backend and distributed
117
+ training configuration. Follow the setup and evaluation instructions in the
118
+ [GitHub README](https://github.com/INCEPTIONwang/PolicyTrim#installation), then
119
+ point the corresponding PolicyTrim configuration to the downloaded checkpoint.
120
+
121
+ ## License
122
+
123
+ The released materials are provided under the
124
+ [Apache License 2.0](https://github.com/INCEPTIONwang/PolicyTrim/blob/main/LICENSE).
125
+ Users are also responsible for complying with the licenses and terms of the
126
+ corresponding base VLA models, datasets, and simulation environments.
127
+
128
+ ## Citation
129
+
130
+ If you find PolicyTrim useful, please cite:
131
+
132
+ ```bibtex
133
+ @inproceedings{policytrim2026,
134
+ title = {PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models},
135
+ author = {Xianghui Wang and Feng Chen and Wenbo Zhang and Hua Yan and Zixuan Wang and Changsheng Li and Yinjie Lei},
136
+ booktitle = {European Conference on Computer Vision (ECCV)},
137
+ year = {2026}
138
+ }
139
+ ```