[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the first green block in front of you Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:It is more towards the right side of the table. It is the 4th block from the top on the right side. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 463.6132, 'y': 487.9953}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Find all the blue blocks.  Now, pick up the blue block that is the right-most. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Narrow search to only blue blocks. Find the blue block that is closest to the opposite end of the table. Pick it up. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Reach out and grab the third closest green block on your left side. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:I would them to pick up the block on their left corner. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:From your perspective i would pick the cube in the middle that is green. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is closest to the green block nearest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is in front of the green block closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block closest to your right. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block closest to me Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block closest to you Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:there is an orange block followed by a yellow block followed by another yellow one. The second yellow is the one needed. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick the green block in the middle of the top cluster of green blocks Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Ignore the stack of three blue blocks  and the single blue block and pick up the bottom blue block from the pair. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block on your left side that is the farthest away from you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 427.033, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is in the middle by the 2 orange blocks. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the blue block that is located directly behind the green block closest to you, in the center of the table. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is close to me and is towards the middle Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:You want the orange one closest to you in the grouping of the three. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:In front of me, on my right side is a yellow block and an orange one to the right of it, beside it. Pick up that orange block Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block closest to you. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is the closest to you Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the green block that is positioned closest to you, slightly to your right. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:I would tell the robot to pick up the yellow block that is grouped with other yellow blocks but is closer to me and  not the closest to me but the one to the right of it Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is closest to the left-hand side of the table. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Get up, walk around to my side of the table, and pick up the one yellow block on the table. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is closest to you, the one right in front of you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the green cube that is closest to you Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:It is the block on the top. The block that is closest to me. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is directly behind the green block in front of you. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the block that is dead in the middle. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is behind the orange block and next to the yellow block. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the blue block that is farthest to your right Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block to your left that has two green blocks in front of it and two green block behind it. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block closest to you on your right hand side. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:blue block touching a blue and orange block Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the green block which is the farthest to my right. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is all by itself off to the side, next to the yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is furthest away from me. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is next to the green block. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the furthest green block on your left. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block closest to me Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block closest to you Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block on the right that is furthest away from any other blue block. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block in the center of the 5 green blocks Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There is one orange block separated from the other ones. Please pick this one. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is off by itself. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up right arm and go to the right middle and pick up block. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:green block in the middle of all the other blocks and surrounded by more green blocks Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is farthest to the right. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is closest to you Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:From your point of view, grab the green block that is directly in front of the right most yellow block. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the last row orange block. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:please pick up the blue block underneath the blue and orange blocks Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block furthest away from you; it is next to two blue blocks. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Right in front of you is a green block, pick that one up. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the leftmost blue block. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the left-most green block from your perspective. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is farthest from you. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is directly to the right of the furthest yellow block on your left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Get the yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:the yellow block that is flush with a green block Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is in between a yellow and an orange block. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the first orange block on your left, toward the top. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is touching sides with a green block. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is between 2 green blocks and is in front of the blue block Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the block closest to you on the right. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:from your point of view grab the third blue block from the left side of the table Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the furthest most top green block. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is above the orange block that is nearest you. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:On your left side, pick up the blue block that is directly to the left of the orange block. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is in the center of the group of five green blocks on your left. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the rightmost blue block Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is the furthest to the right. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block closest to me Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 402.2421, 'y': 551.5495}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Green block in the middle surround by a bunch of other green blocks Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Look at the arrangement of blocks on the table and pick up the blue block which is closest to you and is furthest to the left. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:please pick up the orange block on the left next to the blue Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 342.1981, 'y': 437.4057}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:please pick up the blue block on the right Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There is a block in the middle of the pile. Lift your left hand and put it over the table. i will guide you as to what direction and when to pick up the block Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block directly to the left of the rightmost blue block. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is closest to me. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:I would tell the robot to pick up the orange block on the far right, first row Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the green block closest to me Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 427.033, 'y': 534.6934}[/s]