Skip to content

fix: correctly collect elements in absolute container (#373) #30

fix: correctly collect elements in absolute container (#373)

fix: correctly collect elements in absolute container (#373) #30

Re-run triggered February 10, 2025 13:03
Status Failure
Total duration 9m 12s
Artifacts 1

ai-unit-test.yml

on: push
Matrix: main
Fit to window
Zoom out
Zoom in

Annotations

4 errors
main (18.19.0)
Process completed with exit code 1.
tests/ai/web/puppeteer/agent.test.ts > puppeteer integration > Sauce Demo, agent with yaml script: packages/web-integration/src/common/tasks.ts#L841
Error: Error(s) occurred in running yaml script: task - query weather: AI response error: The result does not show any weather information on the page. Error: AI response error: The result does not show any weather information on the page. at Insight.extract (/home/runner/work/midscene/midscene/packages/midscene/src/insight/index.ts:224:13) at processTicksAndRejections (node:internal/process/task_queues:95:5) at Object.executor (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:841:22) at Object.executor (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:93:24) at Executor.flush (/home/runner/work/midscene/midscene/packages/midscene/src/ai-model/action-executor.ts:126:25) at PageTaskExecutor.query (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:850:20) at PuppeteerAgent.aiQuery (/home/runner/work/midscene/midscene/packages/web-integration/src/common/agent.ts:191:34) at ScriptPlayer.playTask (/home/runner/work/midscene/midscene/packages/web-integration/src/yaml/player.ts:131:29) at ScriptPlayer.run (/home/runner/work/midscene/midscene/packages/web-integration/src/yaml/player.ts:192:9) at PuppeteerAgent.runYaml (/home/runner/work/midscene/midscene/packages/web-integration/src/common/agent.ts:263:5) ❯ Insight.extract ../midscene/src/insight/index.ts:224:13 ❯ Object.executor src/common/tasks.ts:841:22 ❯ Object.executor src/common/tasks.ts:93:24 ❯ Executor.flush ../midscene/src/ai-model/action-executor.ts:126:25 ❯ PageTaskExecutor.query src/common/tasks.ts:850:20 ❯ PuppeteerAgent.aiQuery src/common/agent.ts:191:34 ❯ ScriptPlayer.playTask src/yaml/player.ts:131:29 ❯ ScriptPlayer.run src/yaml/player.ts:192:9 ❯ PuppeteerAgent.runYaml src/common/agent.ts:263:5 ❯ PuppeteerAgent.runYaml src/common/agent.ts:272:13 ❯ tests/ai/web/puppeteer/agent.test.ts:23:24
tests/ai/web/puppeteer/agent.test.ts > puppeteer integration > allow error in flow: packages/web-integration/src/common/tasks.ts#L841
Error: Error(s) occurred in running yaml script: task - query weather: AI response error: The weather information is not present in the provided UI elements or description. Error: AI response error: The weather information is not present in the provided UI elements or description. at Insight.extract (/home/runner/work/midscene/midscene/packages/midscene/src/insight/index.ts:224:13) at processTicksAndRejections (node:internal/process/task_queues:95:5) at Object.executor (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:841:22) at Object.executor (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:93:24) at Executor.flush (/home/runner/work/midscene/midscene/packages/midscene/src/ai-model/action-executor.ts:126:25) at PageTaskExecutor.query (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:850:20) at PuppeteerAgent.aiQuery (/home/runner/work/midscene/midscene/packages/web-integration/src/common/agent.ts:191:34) at ScriptPlayer.playTask (/home/runner/work/midscene/midscene/packages/web-integration/src/yaml/player.ts:131:29) at ScriptPlayer.run (/home/runner/work/midscene/midscene/packages/web-integration/src/yaml/player.ts:192:9) at PuppeteerAgent.runYaml (/home/runner/work/midscene/midscene/packages/web-integration/src/common/agent.ts:263:5) ❯ Insight.extract ../midscene/src/insight/index.ts:224:13 ❯ Object.executor src/common/tasks.ts:841:22 ❯ Object.executor src/common/tasks.ts:93:24 ❯ Executor.flush ../midscene/src/ai-model/action-executor.ts:126:25 ❯ PageTaskExecutor.query src/common/tasks.ts:850:20 ❯ PuppeteerAgent.aiQuery src/common/agent.ts:191:34 ❯ ScriptPlayer.playTask src/yaml/player.ts:131:29 ❯ ScriptPlayer.run src/yaml/player.ts:192:9 ❯ PuppeteerAgent.runYaml src/common/agent.ts:263:5 ❯ PuppeteerAgent.runYaml src/common/agent.ts:272:13 ❯ tests/ai/web/puppeteer/agent.test.ts:67:24
main (18.19.0)
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size Digest
test-ai-output Expired
32.9 MB
sha256:cbdc226ec0044e93c43cc160f2e5502752447e1fdcf6c32eb27ab48f0573f67f