[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block on your left, which is the second from the left nearest you. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the purple block that is the furthest away from you, this block is also the second purple block that you see looking from your right and going left. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:I would tell the robot to pick up the blue block on the far left, just above the yellow block and closer to me Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Look at the yellow block that is furthest to the left on the table. You are to pick up the blue block that is next to it. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the green block closest to you on the left side of the table. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is directly behind the farthest yellow block from you. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the second-nearest blue block to you, the one that is right next to and touching a green block. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is directly behind the green block. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block farthest away from you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the most northern yellow block Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 402.2421, 'y': 551.5495}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:You want to pick up the green block that is directly in front of the yellow block and to your right of the blue block. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Look at the green block in front of you. Do not grab that, but reach for the blue block that is on the other side of it, closest to me. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the green block underneath the two uppermost blue blocks Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the middle green block from the 3 in a horizontal row Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:I would ask them to pick the block slightly to their left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up left arm and go in the middle and pick up block. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:yellow block right in the middle surrounded by many blocks. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is directly in front of you. It is the second green block from the right. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block between 2 other blue blocks on the left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Of the two parallel green blocks, pick up the leftmost of them. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block on the left that's touching the yellow block furthest away from you. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the orange block that is nearest to me. It is the orange block directly adjacent to, and slightly to the left of, the to the yellow block nearest me. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There is a block in the back of the pile. Lift your left hand and put it over the table. i will guide you as to what direction and when to pick up the block. It is the 2nd to the last block at the end Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow  block. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are 2 blue blocks far from you that are touching or almost touching each other. Of those 2 blue blocks, pick up the one on the left. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Touch the block that's located on the furthest north from you, and then pick up the closest blue blue block Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There is a cluster of 3 blue blocks to your left. It is near an orange block. Grab the one in the center, it should be the closest one to you in that group. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:the closest yellow block to me Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 402.2421, 'y': 551.5495}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow cube. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the Yellow Block which has the majority of its left side touched by a green block. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the closest green block in front of you Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:The block is on the left side of the table. It is the one closest to the left corner. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Find the two blue blocks farthest away from you and pick up the one on the right. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:All the way to your left is a green block with another green block behind it. Pick up the green block in front of the farthest green one. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up ht blue block to the bottom left of the rightmost yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are two yellow blocks inbetween blue blocks on either side. Pick up the yellow bock to the right in between those two blue blocks. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There is a group of three green block near the yellow block furthest from you. Pick up the left-most green block in front of the yellow block. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is above a green block, but below a blue block in the center of the table. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is slightly to the side of the closest orange block to you. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:please pick up the orange block underneath the orange but almost touching the yellow Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is behind the two yellow blocks. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the block most close to you Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:If you follow from the orange block in front of you on your right and move forward, you will come to a yellow block, then another yellow, then yet another yellow. This yellow block is also touching a blue block to the right - pick up this yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pickup the green block that is closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is the farthest to the left. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is directly above an orange block, and to the left of a yellow and blue block. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is closest to you. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 342.1981, 'y': 437.4057}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the nearest green block to you Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that has two green blocks above and below it. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the blue block that is to your farthest left on the table. It is the one almost directly in front of a green block, and to the left of an orange block. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:To your left, there is a group of three blue blocks between a yellow block and an orange block: pick up the middle blue block. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Reach forward in the center and pick up the green block that is immediately before the yellow block. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the blue cube furthest to your right Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:On your right side there is a blue block sitting next to a yellow. No other blocks are touching them. Pick up this blue block. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Take the green block closer to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:the blue block farthest back located behind the orange and green blocks Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block directly in front of you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Find the two yellow blocks that are directly next to each other and facing the same direction. Pick up the one on the right. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block next to the green block farthest to your left. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 463.6132, 'y': 487.9953}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the green block in the center of the table next to two orange blocks. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:grab the green block in the center of all of the blocks. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:From your perspective i would choose the second blue block to the left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:From your point of view, grab the Green block furthest to the left. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Skip over the first two green blocks that are in front of you and pick up the green box directly in front of them. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Take the orange block that is all the way on the right. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the green block that is in the middle of the cluster of 3 green blocks. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the block all the way to your right. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up your left hand, place it on the table,  slide it to the right and touch the first green block you see. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the only yellow cube. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the right most green block Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the orange block that is closest to me. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 342.1981, 'y': 437.4057}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is right behind the green block closest to you Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the green block at the very top right above yellow block. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is the furthermost block away from you on the table. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:grab the green block that is closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is farthest to your left Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block closest to you that is also touching the left-most blue block. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 463.6132, 'y': 487.9953}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:The yellow block in the center, it is sitting next to a green block Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick the second blue block from the bottom Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:From your point of view, grab the left most green block. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 427.033, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please select the green box furtherest away from you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 427.033, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the only green block that is on your far left side. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the 1st orange block that is in front of the orange block Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the yellow block Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:the middle row of green blocks. the green block that is in the center. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block on your right side. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block second from your left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]