Prompt for action completion

Description from the leaf node in HTT for AI2THOR: Place a rinsed spoon into the drawer

Prompt: API functions of the supported objects and actions are (selected environment provided relevant object types by LLM):

• (‘spatula’, [‘pickupable’]),

• (‘cabinet’, [‘openable’, ‘receptacle’]),

• (‘apple’, [‘pickupable’, ‘sliceable’]),

• (‘microwave’, [‘openable’, ‘toggleable’, ‘receptacle’, ‘movable’]),

• (‘spoon’, [‘pickupable’]),

• (‘counter’, [‘receptacle’]),

• (‘drawer’, [‘openable’, ‘receptacle’])

The robot can do these actions (selected environment provided possible actions by LLM):

• find_object_by_state(object_type,[states]), states can be “sliced”, “cleaned”, “chilled”, “heated”, “cracked”, “used up”, i.e., find_object_by_state(pear,[sliced, cleaned]): find a pear [sliced or cleaned];

• move_to(object_type), i.e., move_to(banana) the agent go to a place near banana;

• pickup_object(object_type), i.e., pickup_object(apple) pick up an apple;

• open_object(object_type), i.e., open_object(book) open book;

• place_object(object_type), i.e., place_object() release object in hand;

• close_object(object_type), i.e., close_object(book) close book;

• fill_object_with_liquid(object_be_filled, liquid), i.e., fill_object_with_liquid(cup, coffee) fill cup with coffee;

• cook_object(object_type), i.e., cook_object(egg) cook egg

For the task “Place a rinsed spoon into the drawer” (description from HTT’s leaf node), generate a sequence of actions with the API functions provided above. Please reply in format:

{
"reasoning_and_explaination":    
"task_sequence":['find_object_by_state(pineapple,heat)','move_to(pineapple)'](the splittd task sequence),
}

Possible output from LLM:

{
"reasoning_and_explanation": "To complete the task of placing a rinsed spoon into the drawer, the robot must first locate a spoon that has been rinsed (assuming 'rinsed' is a state similar to 'cleaned'). After finding the spoon, the robot needs to move to the location of the spoon to pick it up. Once the spoon is in the robot's possession, the robot must locate a drawer, move to it, and then open the drawer to place the spoon inside. Finally, the robot should close the drawer to complete the task.",

"task_sequence": [
    "find_object_by_state(spoon, [cleaned])",
    "move_to(spoon)",
    "pickup_object(spoon)",
    "find_object_by_state(drawer, [])",
    "move_to(drawer)",
    "open_object(drawer)",
    "place_object()",
    "close_object(drawer)"  
    ]
}