Error: Snapshot `system prompt to task planning > planning - 4o 1` mismatched - Expected + Received @@ -47,16 +47,16 @@ * `value` is the final required input value based on the existing input. No matter what modifications are required, just provide the final value to replace the existing input value. - type: 'KeyboardPress', press a key * { param: { value: string } } - type: 'Scroll', scroll up or down. * { - locate: {"id": string, "prompt": string} | null, + locate: {"id": string, "prompt": string} | null, - param: { + param: { - direction: 'down'(default) | 'up' | 'right' | 'left', + direction: 'down'(default) | 'up' | 'right' | 'left', - scrollType: 'once' (default) | 'untilBottom' | 'untilTop' | 'untilRight' | 'untilLeft', + scrollType: 'once' (default) | 'untilBottom' | 'untilTop' | 'untilRight' | 'untilLeft', - distance: null | number + distance: null | number - } + } } * To scroll some specific element, put the element at the center of the region in the `locate` field. If it's a page scroll, put `null` in the `locate` field. * `param` is required in this action. If some fields are not specified, use direction `down`, `once` scroll type, and `null` distance. - type: 'ExpectedFalsyCondition' * { param: { reason: string } } @@ -89,53 +89,53 @@ * The main steps should be: tap the switch button, sleep, and tap the 'English' option * The language switch button is shown in the screenshot, but it's not marked with a rectangle. So we have to use the page description to find the element. By carefully checking the context information (coordinates, attributes, content, etc.), you can find the element. * The "English" option button is not shown in the screenshot now, it means it may only show after the previous actions are finished. So don't plan any action to do this. * Log what these action do: Click the language switch button to open the language options. Wait for 1 second. - * The task cannot be accomplished (because we cannot see the "English" option now), so the `finish` field is false. + * The task cannot be accomplished (because we cannot see the "English" option now), so the `more_actions_needed_by_instruction` field is true. { "actions":[ { - "type": "Tap", + "type": "Tap", - "thought": "Click the language switch button to open the language options.", + "thought": "Click the language switch button to open the language options.", - "param": null, + "param": null, - "locate": { id: "c81c4e9a33", prompt: "The language switch button" }, + "locate": { id: "c81c4e9a33", prompt: "The language switch button" }, }, { - "type": "Sleep", + "type": "Sleep", - "thought": "Wait for 1 second to ensure the language options are displayed.", + "thought": "Wait for 1 second to ensure the language options are displayed.", - "param": { "timeMs": 1000 }, + "param": { "timeMs": 1000 }, } ], "error": null, - "finish": false, + "more_actions_needed_by_instruction": true, "log": "Click the language switch button to open the language options. Wait for 1 second", } ### Example: What NOT to do Wrong output: { "actions":[ { - "type": "Tap", + "type": "Tap", - "thought": "Click the language switch button to open the language options.", + "thought": "Click the language switch button to open the language options.", - "param": null, + "param": null, - "locate": { + "locate": { - { "id": "c81c4e9a33" }, // WRONG: prompt is missing + { "id": "c81c4e9a33" }, // WRONG: prompt is missing - } + } }, { - "type": "Tap", + "type": "Tap", - "thought": "Click the English option", + "thought": "Click the English option", - "param": null, + "param": null, - "locate": null, // This means the 'English' option is not shown in the screenshot, the task cannot be accomplished + "locate": null, // This means the 'English' option is not shown in the screenshot, the task cann

Error: Snapshot `system prompt to task planning > planning - 4o - response format 1` mismatched - Expected + Received @@ -128,22 +128,22 @@ "type": [ "string", "null", ], }, - "finish": { + "log": { - "description": "If all the actions described in the instruction have been covered by this action and logs, set this field to true.", + "description": "Log what these planned actions do. Do not include further actions that have not been planned.", - "type": "boolean", + "type": "string", }, - "log": { - "description": "Log what these planned actions do. Do not include further actions that have not been planned.", + "more_actions_needed_by_instruction": { + "description": "If all the actions described in the instruction have been covered by this action and logs, set this field to false.", - "type": "string", + "type": "boolean", }, }, "required": [ "actions", - "finish", + "more_actions_needed_by_instruction", "log", "error", ], "strict": true, "type": "object", ❯ tests/unit-test/prompt/prompt.test.ts:18:20

Process completed with exit code 1.