[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the yellow block that is completely surrounded by 3 green blocks and 1 blue block and 1 other yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 463.6132, 'y': 487.9953}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Going form right to left, touch the third blue block on the table. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:look on your right, you'll see an orange cube, then a yellow cube, then another yellow cube. Pick up that second yellow cube. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block farthest away from you. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block on the table. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the yellow cube that is in between two green cubes Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 463.6132, 'y': 487.9953}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block which is farthest from you. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the 3rd blue block from your right. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the far left front orange block that is somewhat in its own space away from the other blocks. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:The closest block to you is green. Pick it up. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is behind the green block closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the second block from the left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is closer to you than all the other orange blocks. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 342.1981, 'y': 437.4057}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Near you in the middle, you see one green, then two blue blocks.  Please select blue block number 1. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up right arm and go to the middle of the blocks and pick up middle block. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is closest to me. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 402.2421, 'y': 551.5495}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block closest to you. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 342.1981, 'y': 437.4057}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the green block on the left side of the table. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block closest to me and on my right hand side. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is behind the two green blocks closest to you on your left. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the green block on the top right, under the blue blocks Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the yellow block that is surrounded by three green blocks and a blue block. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 463.6132, 'y': 487.9953}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the second green block from the top Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the yellow block that is to left side of the blue block on your right side Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is the furthest away, and which is next to the single yellow block. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the only blue block that is on your far left side. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block nearest to you, the one second from your right. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:To the right of you, grab the block at the utmost top to the right. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the first block Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Look at the group of 3 green blocks that are touching in the middle of the group.  Grab the leftmost one out of those 3. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the 3rd blue block starting from the right side. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that has two yellow blocks to its right and a green block to its left. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is directly in front of you. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Look for a blue block. Pick up the blue block that is furthest away from you. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the third blue block from your left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the yellow block that is the closest to me Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 402.2421, 'y': 551.5495}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block at the top left portion of the blocks. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the green block between two green blocks Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are three blue blocks close to you on the left side of the table - pick up the one that's directly between two other ones. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is the farthest way from you, or closest to me. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the green block that is right between the cluster of green blocks Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:grab the closest green block Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the green cube closest to you Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block near to the green block. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is in the middle of  the group of 5 green blocks. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is furthest from you. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block to your left in between the green and yellow block. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the middle green block from the group of 5 Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There's a row of three green blocks with a blue on one end and yellow on the other. Pick up the middle green. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is third from your left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is the furthermost away from you. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Narrow search to only yellow blocks. Look at the yellow blocks closest to the right of the table. Look for the fourth-closest to the right of the table. Pick it up. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the farthest away orange block Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the only green block to your left. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block nearest you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is closest to me, and separated from the rest of the blocks. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the first blue block on the right side Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the closest block to you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are 5 green blocks on the left side of the table.  Please pick up the green block in the middle of this group. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the yellow block nearest to me. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 402.2421, 'y': 551.5495}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:To your right, count 2 blocks, then grab the one immediately after it. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is second from the right from your view. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the yellow block third from your right Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the second furthest blue block away from you. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are five blocks that are green in close proximity to each other, you can see them starting from your left. Pick up the green block that is in the middle of the group. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block furthest to your right. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is face to face with another green block to its right. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:blue block on the right that is right below an orange block. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up left hand and pick up 2nd block to the left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the green block that is directly to the right of the one in the center. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block in front of the yellow block to your left Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Take the green block that has two orange blocks behind it. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Use your right arm and put it on the edge of the table straight ahead.  Slide your hand sideways until you feel 3 blocks.  Grab the middle one. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is farther away from you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the blue block that's on the right side of the table - it is pretty close to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the second from the left blue block, which is next to an orange block. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the closest block to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pickup the green block that is the farthest to the right. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is by itself. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is in front of the orange block. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Stand up, lean over the table, and pick up the tan block that is closest to me. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is next to the two green blocks Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is sandwiched between two other green blocks located on the right side of the table. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are 2 orange blocks that are touching or are very close together. Pick up the block of those 2 that is closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is the furthest away from you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 427.033, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the blue block that is directly behind, not adjacent to, the orange block in the center-left of the table.  It is the blue block that it turned so that it mimics the shape of a diamond. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the green block that is in the center of the table and touching one other green block. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]