[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the closer yellow block that's touching a green block. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There is one orange block, the next block closest to my side is yellow pick up the green block that is touching that yellow block. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are 3 green blocks close together in the middle of the table.  Please pick up the green block in the middle of the three green blocks. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the block closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the furthest left orange block. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:the second blue block from my left Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange cube found furthest from you. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the nearest orange block. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the orange block that is isolated from all the other blocks. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is above the bottommost green block. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 378.7783, 'y': 457.6415}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block on your left. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the closest green block Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is to the right and behind the orange block Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is the second farthest away from yo at the top. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Look for a yellow block. Pick up the yellow block that is the second furthest to the right. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 463.6132, 'y': 487.9953}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the leftmost green block. This block is next to the leftmost blue block. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is closet to you. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:please pick up the yellow block next to the blue one on the farthest left Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are two green blocks right in front of you, behind them to your left are two green blocks close to one another. Pick up the left most block of those two that are almost touching. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Raise your right hand, place it on the table, and slide it forward to the second orange block. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the farthest blue block from you that is directly above the orange block. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is directly below two orange blocks. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue cube closest to me on your right. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block on your left that is closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:green block closest to you Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:You are to pick up a yellow block. It is on your right side and is above and touching a blue block. It is the lower of the two yellow blocks that are just below the single yellow block that is furthest away from you. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the orange cube that is furthest away from you. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick the green block in the middle of the horizontal line of green blocks. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the second green block from the right Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:the green block closest to you Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is to your left of the blue block and has three other yellow blocks surrounding it. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is being touched by two other yellow blocks and a blue block Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block furthest from you. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the solitary orange block closest to me Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:I would ask them to pick the block in front of them to their right. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Look for a green block. Pick up the green block that is furthest to the left of you. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is the farthest away from you on your left side. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the first blue block to the left of the brown block on your left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There is one orange block that is not near any other blocks - it is in the top left corner - please pick that one up. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please select the yellow block next to the blue block on your right hand side near the center of the table. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is the furthest away from you, directly behind the yellow block. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block all the way in the back on your left Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is  to the immediate left of the blue block on your right. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block on your left. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block to the left of the blue block farthest to your right. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 324.2972, 'y': 499.6698}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the yellow block Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 290.8302, 'y': 554.1509}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There is 3 orange blocks pretty close together. Pick the orange block that is the farther one away from you. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the closest orange block to you on your right side. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 342.1981, 'y': 437.4057}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the farthest away orange block Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block on the left corner Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Grab the blue block on your left. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the green block that is positioned closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 317, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 293, 'y': 534}}, {'name': 'green', 'keypoint': {'x': 304, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 338, 'y': 524}}, {'name': 'green', 'keypoint': {'x': 297, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 343, 'y': 417}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 370, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 423, 'y': 481}}, {'name': 'green', 'keypoint': {'x': 428, 'y': 541}}, {'name': 'orange', 'keypoint': {'x': 450, 'y': 452}}, {'name': 'yellow', 'keypoint': {'x': 480, 'y': 437}}, {'name': 'yellow', 'keypoint': {'x': 482, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 496, 'y': 534}}][/INST] {'x': 345.3113, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:On your left hand side, count 2 blocks, then grab the one immediately after it. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the green block that is directly in the center of all the blocks. Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 386.5613, 'y': 498.8915}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block on your far left. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:the isolated orange block on the corner Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block furthest to your left. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 466.7264, 'y': 500.4481}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the yellow block that is on your right, but not the one that is furthest right, but the one next to it. Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pickup the green block that is second farthest to the right. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block to your left that is immediately in front of an orange and a blue block. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Narrow search to only orange blocks. Find the orange block that is furthest to the opposite side of the table. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 433.2153, 'y': 530.9007}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Please pick up the orange block that is located on your left and positioned closest to me. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 494.7453, 'y': 534.6934}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the second yellow block from the left that is closest to you Image description: [{'name': 'yellow', 'keypoint': {'x': 304, 'y': 547}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 498}}, {'name': 'yellow', 'keypoint': {'x': 309, 'y': 451}}, {'name': 'orange', 'keypoint': {'x': 305, 'y': 430}}, {'name': 'yellow', 'keypoint': {'x': 330, 'y': 464}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 346, 'y': 515}}, {'name': 'yellow', 'keypoint': {'x': 379, 'y': 470}}, {'name': 'blue', 'keypoint': {'x': 384, 'y': 507}}, {'name': 'yellow', 'keypoint': {'x': 402, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 425}}, {'name': 'orange', 'keypoint': {'x': 469, 'y': 449}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 490}}, {'name': 'green', 'keypoint': {'x': 493, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 519}}][/INST] {'x': 330.5236, 'y': 470.8726}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block closest to you. Image description: [{'name': 'yellow', 'keypoint': {'x': 312, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 346, 'y': 510}}, {'name': 'blue', 'keypoint': {'x': 356, 'y': 485}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 481}}, {'name': 'yellow', 'keypoint': {'x': 340, 'y': 442}}, {'name': 'green', 'keypoint': {'x': 353, 'y': 421}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 437}}, {'name': 'orange', 'keypoint': {'x': 406, 'y': 458}}, {'name': 'yellow', 'keypoint': {'x': 392, 'y': 499}}, {'name': 'yellow', 'keypoint': {'x': 446, 'y': 426}}, {'name': 'orange', 'keypoint': {'x': 468, 'y': 459}}, {'name': 'green', 'keypoint': {'x': 469, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 500, 'y': 463}}, {'name': 'blue', 'keypoint': {'x': 449, 'y': 538}}, {'name': 'blue', 'keypoint': {'x': 501, 'y': 528}}][/INST] {'x': 355.4292, 'y': 424.9528}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is in between the yellow and orange blocks on your far right hand side. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Touch the first blue block on the table, from your right. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Of the three orange blocks, pick up the one closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are three orange blocks. Pick up the one closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 332.0802, 'y': 517.5708}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:From your perspective i would pick the farthest blue cube. The one that reaches the farthest. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 329.7453, 'y': 557.2642}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the center blue block on your left. Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 462.0566, 'y': 469.316}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block furthest to your right. Image description: [{'name': 'yellow', 'keypoint': {'x': 283, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 307, 'y': 537}}, {'name': 'blue', 'keypoint': {'x': 306, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 345, 'y': 548}}, {'name': 'green', 'keypoint': {'x': 374, 'y': 527}}, {'name': 'blue', 'keypoint': {'x': 390, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 382, 'y': 455}}, {'name': 'green', 'keypoint': {'x': 391, 'y': 434}}, {'name': 'blue', 'keypoint': {'x': 438, 'y': 452}}, {'name': 'blue', 'keypoint': {'x': 439, 'y': 472}}, {'name': 'yellow', 'keypoint': {'x': 429, 'y': 510}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 542}}, {'name': 'blue', 'keypoint': {'x': 460, 'y': 497}}, {'name': 'orange', 'keypoint': {'x': 484, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 488, 'y': 468}}][/INST] {'x': 309.5094, 'y': 477.8774}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:grab the green block that is in the middle of the blocks and close to the bottom of the table. Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 378.7783, 'y': 495.7783}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the orange block that is the closest to you. Image description: [{'name': 'green', 'keypoint': {'x': 319, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 313, 'y': 493}}, {'name': 'blue', 'keypoint': {'x': 314, 'y': 475}}, {'name': 'blue', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 342, 'y': 486}}, {'name': 'orange', 'keypoint': {'x': 339, 'y': 433}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 521}}, {'name': 'blue', 'keypoint': {'x': 372, 'y': 480}}, {'name': 'yellow', 'keypoint': {'x': 376, 'y': 427}}, {'name': 'blue', 'keypoint': {'x': 413, 'y': 431}}, {'name': 'blue', 'keypoint': {'x': 405, 'y': 457}}, {'name': 'green', 'keypoint': {'x': 416, 'y': 496}}, {'name': 'yellow', 'keypoint': {'x': 408, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 461, 'y': 470}}, {'name': 'orange', 'keypoint': {'x': 501, 'y': 536}}][/INST] {'x': 342.1981, 'y': 437.4057}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There's two blue blocks furthest away from you. Pick up the center one. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is on your left side and is the third closest to you Image description: [{'name': 'yellow', 'keypoint': {'x': 288, 'y': 540}}, {'name': 'orange', 'keypoint': {'x': 309, 'y': 518}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 517}}, {'name': 'blue', 'keypoint': {'x': 317, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 315, 'y': 445}}, {'name': 'yellow', 'keypoint': {'x': 369, 'y': 427}}, {'name': 'yellow', 'keypoint': {'x': 397, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 381, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 380, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 381, 'y': 554}}, {'name': 'green', 'keypoint': {'x': 434, 'y': 454}}, {'name': 'green', 'keypoint': {'x': 462, 'y': 486}}, {'name': 'green', 'keypoint': {'x': 461, 'y': 446}}, {'name': 'green', 'keypoint': {'x': 443, 'y': 513}}, {'name': 'green', 'keypoint': {'x': 489, 'y': 518}}][/INST] {'x': 458.9434, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is two blocks above the blue block closest to you. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the green block that is closest to you. It is also separated from the other a bit. Image description: [{'name': 'yellow', 'keypoint': {'x': 291, 'y': 544}}, {'name': 'orange', 'keypoint': {'x': 352, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 324, 'y': 532}}, {'name': 'orange', 'keypoint': {'x': 317, 'y': 503}}, {'name': 'green', 'keypoint': {'x': 385, 'y': 547}}, {'name': 'orange', 'keypoint': {'x': 370, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 357, 'y': 470}}, {'name': 'green', 'keypoint': {'x': 313, 'y': 447}}, {'name': 'blue', 'keypoint': {'x': 407, 'y': 504}}, {'name': 'orange', 'keypoint': {'x': 443, 'y': 533}}, {'name': 'blue', 'keypoint': {'x': 452, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 458, 'y': 484}}, {'name': 'orange', 'keypoint': {'x': 464, 'y': 462}}, {'name': 'green', 'keypoint': {'x': 506, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 414, 'y': 454}}][/INST] {'x': 311.066, 'y': 439.7406}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Raise your right hand in the air, reach directly across the table and touch the first yellow block that is directly adjacent to the green block . Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:pick up the yellow cube that is furthest away from you. Image description: [{'name': 'green', 'keypoint': {'x': 313, 'y': 546}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 501}}, {'name': 'blue', 'keypoint': {'x': 302, 'y': 466}}, {'name': 'green', 'keypoint': {'x': 339, 'y': 446}}, {'name': 'orange', 'keypoint': {'x': 358, 'y': 519}}, {'name': 'orange', 'keypoint': {'x': 364, 'y': 460}}, {'name': 'orange', 'keypoint': {'x': 430, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 372, 'y': 492}}, {'name': 'orange', 'keypoint': {'x': 396, 'y': 516}}, {'name': 'yellow', 'keypoint': {'x': 407, 'y': 551}}, {'name': 'orange', 'keypoint': {'x': 434, 'y': 539}}, {'name': 'blue', 'keypoint': {'x': 420, 'y': 483}}, {'name': 'blue', 'keypoint': {'x': 448, 'y': 444}}, {'name': 'yellow', 'keypoint': {'x': 464, 'y': 502}}, {'name': 'green', 'keypoint': {'x': 501, 'y': 465}}][/INST] {'x': 402.2421, 'y': 551.5495}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:in the group of three green blocks in the center. choose the green block in the middle out of those three blocks Image description: [{'name': 'green', 'keypoint': {'x': 321, 'y': 550}}, {'name': 'blue', 'keypoint': {'x': 321, 'y': 515}}, {'name': 'blue', 'keypoint': {'x': 294, 'y': 506}}, {'name': 'green', 'keypoint': {'x': 331, 'y': 491}}, {'name': 'blue', 'keypoint': {'x': 326, 'y': 445}}, {'name': 'green', 'keypoint': {'x': 354, 'y': 499}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 500}}, {'name': 'yellow', 'keypoint': {'x': 375, 'y': 532}}, {'name': 'green', 'keypoint': {'x': 409, 'y': 435}}, {'name': 'green', 'keypoint': {'x': 440, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 432, 'y': 484}}, {'name': 'yellow', 'keypoint': {'x': 471, 'y': 443}}, {'name': 'green', 'keypoint': {'x': 473, 'y': 481}}, {'name': 'orange', 'keypoint': {'x': 473, 'y': 536}}, {'name': 'green', 'keypoint': {'x': 368, 'y': 439}}][/INST] {'x': 353.0943, 'y': 497.3349}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:You are to pick up the green block on your left side. It is below the green block that stands alone and furthest away and is touching a blue block. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 508.7547, 'y': 511.3443}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:grab the second yellow  block from the left that is touching the green block. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Directly in front of you is a yellow block. Pick up the next yellow block you see, the one right in front of the first. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 463.6132, 'y': 487.9953}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block farthest on your right. Image description: [{'name': 'yellow', 'keypoint': {'x': 317, 'y': 548}}, {'name': 'yellow', 'keypoint': {'x': 289, 'y': 498}}, {'name': 'orange', 'keypoint': {'x': 330, 'y': 512}}, {'name': 'blue', 'keypoint': {'x': 325, 'y': 471}}, {'name': 'green', 'keypoint': {'x': 356, 'y': 453}}, {'name': 'green', 'keypoint': {'x': 387, 'y': 495}}, {'name': 'green', 'keypoint': {'x': 397, 'y': 547}}, {'name': 'green', 'keypoint': {'x': 420, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 434, 'y': 548}}, {'name': 'blue', 'keypoint': {'x': 453, 'y': 508}}, {'name': 'yellow', 'keypoint': {'x': 459, 'y': 483}}, {'name': 'green', 'keypoint': {'x': 453, 'y': 446}}, {'name': 'yellow', 'keypoint': {'x': 499, 'y': 449}}, {'name': 'green', 'keypoint': {'x': 510, 'y': 510}}, {'name': 'yellow', 'keypoint': {'x': 354, 'y': 550}}][/INST] {'x': 319.6274, 'y': 463.8679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block that is to my rightest. Image description: [{'name': 'orange', 'keypoint': {'x': 322, 'y': 558}}, {'name': 'blue', 'keypoint': {'x': 352, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 289, 'y': 494}}, {'name': 'green', 'keypoint': {'x': 328, 'y': 463}}, {'name': 'orange', 'keypoint': {'x': 337, 'y': 509}}, {'name': 'orange', 'keypoint': {'x': 292, 'y': 450}}, {'name': 'yellow', 'keypoint': {'x': 382, 'y': 453}}, {'name': 'orange', 'keypoint': {'x': 377, 'y': 477}}, {'name': 'orange', 'keypoint': {'x': 389, 'y': 494}}, {'name': 'yellow', 'keypoint': {'x': 386, 'y': 527}}, {'name': 'orange', 'keypoint': {'x': 439, 'y': 509}}, {'name': 'yellow', 'keypoint': {'x': 484, 'y': 442}}, {'name': 'blue', 'keypoint': {'x': 480, 'y': 479}}, {'name': 'green', 'keypoint': {'x': 515, 'y': 510}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 561}}][/INST] {'x': 487.7406, 'y': 488.7736}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the blue block 2nd closest to you. Image description: [{'name': 'blue', 'keypoint': {'x': 334, 'y': 563}}, {'name': 'yellow', 'keypoint': {'x': 321, 'y': 526}}, {'name': 'orange', 'keypoint': {'x': 336, 'y': 503}}, {'name': 'blue', 'keypoint': {'x': 292, 'y': 470}}, {'name': 'yellow', 'keypoint': {'x': 318, 'y': 450}}, {'name': 'blue', 'keypoint': {'x': 375, 'y': 430}}, {'name': 'orange', 'keypoint': {'x': 376, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 360, 'y': 538}}, {'name': 'green', 'keypoint': {'x': 399, 'y': 475}}, {'name': 'green', 'keypoint': {'x': 407, 'y': 531}}, {'name': 'orange', 'keypoint': {'x': 440, 'y': 426}}, {'name': 'blue', 'keypoint': {'x': 463, 'y': 456}}, {'name': 'yellow', 'keypoint': {'x': 454, 'y': 536}}, {'name': 'orange', 'keypoint': {'x': 492, 'y': 525}}, {'name': 'orange', 'keypoint': {'x': 409, 'y': 442}}][/INST] {'x': 366.3255, 'y': 546.3679}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the third blue block from the left side Image description: [{'name': 'blue', 'keypoint': {'x': 296, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 331, 'y': 551}}, {'name': 'green', 'keypoint': {'x': 336, 'y': 512}}, {'name': 'orange', 'keypoint': {'x': 323, 'y': 485}}, {'name': 'blue', 'keypoint': {'x': 310, 'y': 454}}, {'name': 'yellow', 'keypoint': {'x': 352, 'y': 469}}, {'name': 'blue', 'keypoint': {'x': 395, 'y': 518}}, {'name': 'yellow', 'keypoint': {'x': 420, 'y': 548}}, {'name': 'orange', 'keypoint': {'x': 428, 'y': 444}}, {'name': 'blue', 'keypoint': {'x': 430, 'y': 486}}, {'name': 'blue', 'keypoint': {'x': 459, 'y': 457}}, {'name': 'blue', 'keypoint': {'x': 496, 'y': 459}}, {'name': 'yellow', 'keypoint': {'x': 481, 'y': 480}}, {'name': 'green', 'keypoint': {'x': 484, 'y': 500}}, {'name': 'green', 'keypoint': {'x': 498, 'y': 546}}][/INST] {'x': 440.2642, 'y': 484.8821}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:Pick up the yellow block that is immediately to  the right of a green block. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]


[s][INST] Output only the keypoint location of the block corresponding to following instruction. Instructions are from the perspective of the black figure. Instruction:There are two green blocks right next to each other. One of these green blocks is touching a yellow block. Pick up the yellow block it is touching. This yellow block is next to a bunch of other yellow blocks, but you want to pick up the one that is touching a green block. Image description: [{'name': 'orange', 'keypoint': {'x': 312, 'y': 549}}, {'name': 'orange', 'keypoint': {'x': 333, 'y': 514}}, {'name': 'yellow', 'keypoint': {'x': 315, 'y': 494}}, {'name': 'blue', 'keypoint': {'x': 307, 'y': 439}}, {'name': 'orange', 'keypoint': {'x': 371, 'y': 544}}, {'name': 'yellow', 'keypoint': {'x': 389, 'y': 506}}, {'name': 'yellow', 'keypoint': {'x': 387, 'y': 466}}, {'name': 'yellow', 'keypoint': {'x': 418, 'y': 460}}, {'name': 'yellow', 'keypoint': {'x': 414, 'y': 498}}, {'name': 'green', 'keypoint': {'x': 441, 'y': 489}}, {'name': 'green', 'keypoint': {'x': 456, 'y': 513}}, {'name': 'yellow', 'keypoint': {'x': 468, 'y': 552}}, {'name': 'yellow', 'keypoint': {'x': 505, 'y': 506}}, {'name': 'blue', 'keypoint': {'x': 353, 'y': 466}}, {'name': 'blue', 'keypoint': {'x': 428, 'y': 421}}][/INST] {'x': 413.8019, 'y': 491.1085}[/s]