Add model card and robotics pipeline tag
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,33 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
pipeline_tag: robotics
|
| 4 |
---
|
| 5 |
+
|
| 6 |
+
# PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models
|
| 7 |
+
|
| 8 |
+
This repository contains the models and codebase for **PolicyTrim**, a reinforcement learning-based post-training framework that extends the reliable action chunk length and reduces redundant physical steps for Vision-Language-Action (VLA) models.
|
| 9 |
+
|
| 10 |
+
- **Paper:** [PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models](https://huggingface.co/papers/2606.22540)
|
| 11 |
+
- **Project Page:** [https://inceptionwang.github.io/PolicyTrim/](https://inceptionwang.github.io/PolicyTrim/)
|
| 12 |
+
- **Repository:** [https://github.com/INCEPTIONwang/PolicyTrim](https://github.com/INCEPTIONwang/PolicyTrim)
|
| 13 |
+
|
| 14 |
+
## Introduction
|
| 15 |
+
|
| 16 |
+
PolicyTrim is a two-stage RL post-training framework designed to reduce the number of inference calls required to complete robotic manipulation tasks. It targets two key factors:
|
| 17 |
+
1. **Reliable action chunk extension:** Progressively probes longer execution windows and rewards successful rollouts that sustain longer reliable chunks.
|
| 18 |
+
2. **Redundancy-aware step reduction:** Encourages successful trajectories that reach the goal in fewer physical steps while discouraging fragile, non-reproducible shortcuts.
|
| 19 |
+
|
| 20 |
+
Across three benchmarks (including LIBERO and ManiSkill) and three VLA models (OpenPI, OpenVLA-OFT, and GR00T), PolicyTrim improves action chunk utilization by **3×**, reduces physical execution steps by **51.4%**, and achieves up to a **5.83×** end-to-end deployment speedup without sacrificing task success rates.
|
| 21 |
+
|
| 22 |
+
## Citation
|
| 23 |
+
|
| 24 |
+
If you find PolicyTrim helpful, please cite the following work:
|
| 25 |
+
|
| 26 |
+
```bibtex
|
| 27 |
+
@inproceedings{policytrim2026,
|
| 28 |
+
title = {PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models},
|
| 29 |
+
author = {Xianghui Wang and Feng Chen and Wenbo Zhang and Hua Yan and Zixuan Wang and Changsheng Li and Yinjie Lei},
|
| 30 |
+
booktitle = {European Conference on Computer Vision (ECCV)},
|
| 31 |
+
year = {2026}
|
| 32 |
+
}
|
| 33 |
+
```
|