JerryYuu's picture
Add Brick Diffusion assembly policy and model documentation
174fa34 verified
|
Raw History Blame Contribute Delete
1.38 kB

Brick Diffusion assembly policy

Brick Diffusion is the visuomotor assembly policy accompanying BrickCraft: Visuomotor Skill Composition with Situated Manual Guidance for Long-Horizon Interlocking Brick Assembly. It predicts end-effector pose and gripper actions to place a held target brick onto an existing structure with a single Kinova arm.

See the BrickCraft project website for more information.

Inputs

Field Shape Description
observation.images.wrist_camera 3 × 256 × 256 RGB wrist-camera image
observation.images.fixed_camera 3 × 256 × 256 Segmentation-processed fixed-camera image
observation.state 13 FK end-effector pose (3D position + 6D rotation), gripper position, then scaled XYZ force
observation.task_encoding 6 [x, y, z, orientation, reference_type, target_type]

The policy uses two consecutive observation steps. Images, robot state, and task encoding follow BrickCraft's camera cropping, segmentation, coordinate, unit, and force-scaling conventions. Input normalization uses the statistics saved with the model.

Outputs

Field Shape Description
action 10 per step End-effector pose (3D position + 6D rotation), then gripper position