Yinpei commited on
Commit
23ba5ef
·
1 Parent(s): 2735c87

update task hint

Browse files
Files changed (1) hide show
  1. gradio-web/note_content.py +37 -35
gradio-web/note_content.py CHANGED
@@ -37,40 +37,40 @@ def get_task_hint(env_id):
37
  hints = {
38
  "PickXtimes": """\
39
  To pick up red cubes twice, a typical sequence:
40
- 1. Pick up the cube (click to select the correct color)
41
- 2. Place it on the target.
42
- 3. Pick up the cube (click to select the correct color)
43
- 4. Place it on the target.
44
- 5. Press the button to stop.
45
 
46
  Select "Ground Truth Action" if you need help, then "Execute" it.
47
  """,
48
 
49
  "StopCube": """\
50
  To stop the cube on the target three times, a typical sequence:
51
- 1. Move to the top of the button to prepare.
52
- 2. Remain static for a fixed duration (count how many times the cube passes the target, may select "remain static" multiple times).
53
- 3. When the cube is about to reach the target for the last time, press the button to stop the cube.
54
 
55
  Select "Ground Truth Action" if you need help, then "Execute" it.
56
  """,
57
 
58
  "SwingXtimes": """\
59
  To swing right-to-left twice, a typical sequence:
60
- 1. Pick up the cube (click to select the correct color).
61
- 2. Move to the top of the right target, then the left (click to select each).
62
- 3. Repeat: right, then left.
63
- 4. Put the cube on the table and press the button to stop.
64
 
65
  Spatial directions (left, right) follow the robot base frame.
66
  Select "Ground Truth Action" if you need help, then "Execute" it.
67
  """,
68
 
69
  "BinFill": """\
70
- To pick two red cubes and put them in the bin, a typical sequence:
71
- 1. Pick up a red cube (click to select), then put it in the bin.
72
- 2. Pick up another red cube (click to select), then put it in the bin.
73
- 3. Press the button to stop.
74
 
75
  Select "Ground Truth Action" if you need help, then "Execute" it.
76
  """,
@@ -78,7 +78,7 @@ Select "Ground Truth Action" if you need help, then "Execute" it.
78
  "VideoUnmaskSwap": """\
79
  Watch the video: cubes are hidden by containers. Memorize each cube's color. Track the swap of containers.
80
  Typical sequence:
81
- 1. Pick up a container (click to select), then put it down.
82
  Repeat for a second container if the goal is to find two cubes.
83
 
84
  Select "Ground Truth Action" if you need help, then "Execute" it.
@@ -97,17 +97,17 @@ Select "Ground Truth Action" if you need help, then "Execute" it.
97
  Press the buttons. While doing so, cubes are hidden in containers. Memorize each cube's color. Track the swap of containers.
98
  Typical sequence:
99
  1. Press the first button, then the second.
100
- 2. Pick up a container (click to select), then put it down.
101
  Repeat for a second container if the goal is to find two cubes.
102
 
103
  Select "Ground Truth Action" if you need help, then "Execute" it.
104
  """,
105
 
106
  "ButtonUnmask": """\
107
- Press the buttons in order. Cubes are hidden in containers—memorize each cube's color.
108
  Typical sequence:
109
- 1. Press the button.
110
- 2. Pick up a container (click to select), then put it down.
111
  Repeat for a second container if the goal is to find two cubes.
112
 
113
  Select "Ground Truth Action" if you need help, then "Execute" it.
@@ -116,10 +116,10 @@ Select "Ground Truth Action" if you need help, then "Execute" it.
116
  "VideoRepick": """\
117
  Remember which cube was picked in the video, then pick it again. Cube positions may be swapped.
118
  Typical sequence:
119
- 1. Pick up the correct cube (click to select by color)
120
- 2. Put it down.
121
- 3. Repeat step 1 for the required number of times.
122
- 4. Press the button to finish.
123
 
124
  Select "Ground Truth Action" if you need help, then "Execute" it.
125
  """,
@@ -127,8 +127,8 @@ Select "Ground Truth Action" if you need help, then "Execute" it.
127
  "VideoPlaceButton": """\
128
  The video shows a robot placing a cube on different targets and pressing the button in sequence. Targets may change positions.
129
  Typical sequence:
130
- 1. Pick up the correct cube (click to select)
131
- 2. Drop it onto the target (click to select target).
132
 
133
  Select "Ground Truth Action" if you need help, then "Execute" it.
134
  """,
@@ -136,17 +136,19 @@ Select "Ground Truth Action" if you need help, then "Execute" it.
136
  "VideoPlaceOrder": """\
137
  The video shows a robot placing a cube on different targets and pressing the button in sequence. Targets may change positions.
138
  Typical sequence:
139
- 1. Pick up the correct cube (click to select)
140
- 2. Drop it onto the target (click to select target).
141
 
142
  Select "Ground Truth Action" if you need help, then "Execute" it.
143
  """,
144
 
145
  "PickHighlight": """\
146
- While the robot presses the button, some cubes are highlighted with white discs—remember them.
147
  Typical sequence:
148
- 1. Press the button.
149
- 2. Pick up each highlighted cube (click to select), place the cube onto the table. Repeat for all highlighted cubes.
 
 
150
 
151
  Select "Ground Truth Action" if you need help, then "Execute" it.
152
  """,
@@ -154,8 +156,8 @@ Select "Ground Truth Action" if you need help, then "Execute" it.
154
  "InsertPeg": """\
155
  The video shows a robot inserting a peg into a hole. The peg has two colored parts—pick the correct part and insert from the correct side.
156
  Typical sequence:
157
- 1. Pick up the peg (click to select correct peg and part).
158
- 2. Insert it into the hole on the left.
159
 
160
  Spatial directions (left, right) follow the robot base frame.
161
  Select "Ground Truth Action" if you need help, then "Execute" it.
@@ -169,7 +171,7 @@ Select "Ground Truth Action" if you need help, then "Execute" it.
169
  """,
170
 
171
  "PatternLock": """\
172
- The video shows a robot tracing a pattern with a stick. Remember the movements and reproduce them.
173
 
174
  Spatial directions (left, right, forward, backward) follow the robot base frame.
175
  Select "Ground Truth Action" if you need help, then "Execute" it.
 
37
  hints = {
38
  "PickXtimes": """\
39
  To pick up red cubes twice, a typical sequence:
40
+ 1. pick up the cube (click to select the correct color)
41
+ 2. place it on the target.
42
+ 3. pick up the cube (click to select the correct color)
43
+ 4. place it on the target.
44
+ 5. press the button to stop.
45
 
46
  Select "Ground Truth Action" if you need help, then "Execute" it.
47
  """,
48
 
49
  "StopCube": """\
50
  To stop the cube on the target three times, a typical sequence:
51
+ 1. move above the button to prepare.
52
+ 2. remain static for a fixed duration (count how many times the cube passes the target, may select "remain static" multiple times).
53
+ 3. when the cube is about to reach the target for the last time, press the button to stop.
54
 
55
  Select "Ground Truth Action" if you need help, then "Execute" it.
56
  """,
57
 
58
  "SwingXtimes": """\
59
  To swing right-to-left twice, a typical sequence:
60
+ 1. pick up the cube (click to select the correct color).
61
+ 2. move above the right target, then the left (click to select each).
62
+ 3. move to the right target again, then the left again (click to select each).
63
+ 4. put the cube on the table and press the button to stop.
64
 
65
  Spatial directions (left, right) follow the robot base frame.
66
  Select "Ground Truth Action" if you need help, then "Execute" it.
67
  """,
68
 
69
  "BinFill": """\
70
+ Suppose the task is to pick two red cubes and put them into the bin, a typical sequence:
71
+ 1. pick up a red cube (click to select), then put it in the bin.
72
+ 2. pick up another red cube (click to select), then put it in the bin.
73
+ 3. press the button to stop.
74
 
75
  Select "Ground Truth Action" if you need help, then "Execute" it.
76
  """,
 
78
  "VideoUnmaskSwap": """\
79
  Watch the video: cubes are hidden by containers. Memorize each cube's color. Track the swap of containers.
80
  Typical sequence:
81
+ 1. pick up a container (click to select), then drop it.
82
  Repeat for a second container if the goal is to find two cubes.
83
 
84
  Select "Ground Truth Action" if you need help, then "Execute" it.
 
97
  Press the buttons. While doing so, cubes are hidden in containers. Memorize each cube's color. Track the swap of containers.
98
  Typical sequence:
99
  1. Press the first button, then the second.
100
+ 2. pick up a container (click to select), then drop it.
101
  Repeat for a second container if the goal is to find two cubes.
102
 
103
  Select "Ground Truth Action" if you need help, then "Execute" it.
104
  """,
105
 
106
  "ButtonUnmask": """\
107
+ Press the button first. While doing so, cubes are hidden in containers. Memorize each cube's color.
108
  Typical sequence:
109
+ 1. press the button.
110
+ 2. pick up a container (click to select), then drop it.
111
  Repeat for a second container if the goal is to find two cubes.
112
 
113
  Select "Ground Truth Action" if you need help, then "Execute" it.
 
116
  "VideoRepick": """\
117
  Remember which cube was picked in the video, then pick it again. Cube positions may be swapped.
118
  Typical sequence:
119
+ 1. pick up the correct cube (click to select by color)
120
+ 2. put it on the table.
121
+ 3. repeat step 1 for the required number of times.
122
+ 4. press the button to stop.
123
 
124
  Select "Ground Truth Action" if you need help, then "Execute" it.
125
  """,
 
127
  "VideoPlaceButton": """\
128
  The video shows a robot placing a cube on different targets and pressing the button in sequence. Targets may change positions.
129
  Typical sequence:
130
+ 1. pick up the correct cube (click to select)
131
+ 2. place it on the target (click to select target).
132
 
133
  Select "Ground Truth Action" if you need help, then "Execute" it.
134
  """,
 
136
  "VideoPlaceOrder": """\
137
  The video shows a robot placing a cube on different targets and pressing the button in sequence. Targets may change positions.
138
  Typical sequence:
139
+ 1. pick up the correct cube (click to select)
140
+ 2. place it on the target (click to select target).
141
 
142
  Select "Ground Truth Action" if you need help, then "Execute" it.
143
  """,
144
 
145
  "PickHighlight": """\
146
+ While pressing the button, some cubes are highlighted with white discs. Remember them.
147
  Typical sequence:
148
+ 1. press the button.
149
+ 2. pick up each highlighted cube (click to select)
150
+ 3. place the cube onto the table.
151
+ Repeat for all highlighted cubes.
152
 
153
  Select "Ground Truth Action" if you need help, then "Execute" it.
154
  """,
 
156
  "InsertPeg": """\
157
  The video shows a robot inserting a peg into a hole. The peg has two colored parts—pick the correct part and insert from the correct side.
158
  Typical sequence:
159
+ 1. pick up the peg (click to select correct peg and part).
160
+ 2. insert it into the hole on the left.
161
 
162
  Spatial directions (left, right) follow the robot base frame.
163
  Select "Ground Truth Action" if you need help, then "Execute" it.
 
171
  """,
172
 
173
  "PatternLock": """\
174
+ The video shows a robot drawing a pattern. Remember the movements and reproduce them faithfully.
175
 
176
  Spatial directions (left, right, forward, backward) follow the robot base frame.
177
  Select "Ground Truth Action" if you need help, then "Execute" it.