Papers
arxiv:2607.06442

SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA Models

Published on Jul 7
ยท Submitted by
Changti Wu
on Jul 8
Authors:
,
,
,
,
,
,
,
,

Abstract

SIEVE is a structure-aware data selection method for vision-language-action imitation learning that identifies reusable visuo-motor primitives and transition interfaces to improve policy learning efficiency.

Vision-Language-Action (VLA) models are typically trained by imitation learning on large-scale robot demonstration datasets, but more data does not necessarily yield better policies due to redundancy, noise, and uneven coverage. Existing data selection methods often assess demonstrations at either the trajectory or state-action level, missing the reusable structures that compose long-horizon behaviors. In this paper, we propose SIEVE, a structure-aware data selection method for VLA imitation learning. SIEVE views demonstrations as compositions of reusable primitives and transition interfaces. It first discovers visuo-motor primitives from segmented trajectories, then allocates selection budgets to composition patterns by maximizing reuse-aware structural exposure under diminishing returns. Finally, it selects medoid trajectories within each composition-pattern bucket to retain central, stable, and imitation-friendly demonstrations. Experiments across multiple datasets, benchmarks, and VLA models show that SIEVE consistently outperforms competitive data selection baselines. Notably, SIEVE can surpass full-data training while using only 50% of demonstrations and 50% of training steps, suggesting that reusable structure, captured through primitives and transitions, is an important signal for efficient VLA imitation learning.

Community

๐Ÿš€ Do VLA models need more data, or better data?

We introduce SIEVE, a structure-aware data selection method for VLA imitation learning.

Instead of treating demonstrations as isolated trajectories, SIEVE views them as compositions of reusable visuo-motor primitives and transition interfaces.

โœจ What SIEVE does:

๐Ÿ”น discovers reusable primitives from robot trajectories
๐Ÿ”น allocates data budgets to structurally informative composition patterns
๐Ÿ”น selects central, stable demonstrations that are easier for behavior cloning to learn from

๐Ÿ“Š Results:

โœ… Consistently beats strong data selection baselines
โœ… Works across multiple datasets, benchmarks, and VLA models
โœ… Surpasses full-data training with only 50% data + 50% training steps

๐Ÿ’ก Takeaway:

For efficient VLA training, selecting reusable behavioral structure can be more important than simply scaling up robot data.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2607.06442
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2607.06442 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2607.06442 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2607.06442 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.