SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA Models
Abstract
SIEVE is a structure-aware data selection method for vision-language-action imitation learning that identifies reusable visuo-motor primitives and transition interfaces to improve policy learning efficiency.
Vision-Language-Action (VLA) models are typically trained by imitation learning on large-scale robot demonstration datasets, but more data does not necessarily yield better policies due to redundancy, noise, and uneven coverage. Existing data selection methods often assess demonstrations at either the trajectory or state-action level, missing the reusable structures that compose long-horizon behaviors. In this paper, we propose SIEVE, a structure-aware data selection method for VLA imitation learning. SIEVE views demonstrations as compositions of reusable primitives and transition interfaces. It first discovers visuo-motor primitives from segmented trajectories, then allocates selection budgets to composition patterns by maximizing reuse-aware structural exposure under diminishing returns. Finally, it selects medoid trajectories within each composition-pattern bucket to retain central, stable, and imitation-friendly demonstrations. Experiments across multiple datasets, benchmarks, and VLA models show that SIEVE consistently outperforms competitive data selection baselines. Notably, SIEVE can surpass full-data training while using only 50% of demonstrations and 50% of training steps, suggesting that reusable structure, captured through primitives and transitions, is an important signal for efficient VLA imitation learning.
Community
๐ Do VLA models need more data, or better data?
We introduce SIEVE, a structure-aware data selection method for VLA imitation learning.
Instead of treating demonstrations as isolated trajectories, SIEVE views them as compositions of reusable visuo-motor primitives and transition interfaces.
โจ What SIEVE does:
๐น discovers reusable primitives from robot trajectories
๐น allocates data budgets to structurally informative composition patterns
๐น selects central, stable demonstrations that are easier for behavior cloning to learn from
๐ Results:
โ
Consistently beats strong data selection baselines
โ
Works across multiple datasets, benchmarks, and VLA models
โ
Surpasses full-data training with only 50% data + 50% training steps
๐ก Takeaway:
For efficient VLA training, selecting reusable behavioral structure can be more important than simply scaling up robot data.
Get this paper in your agent:
hf papers read 2607.06442 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper