Skip to content

fix(core): aiTap Images does not work && feat(core): make the images provided by aiTap truly effective#2222

Open
e790a8 wants to merge 20 commits intoweb-infra-dev:mainfrom
e790a8:main
Open

fix(core): aiTap Images does not work && feat(core): make the images provided by aiTap truly effective#2222
e790a8 wants to merge 20 commits intoweb-infra-dev:mainfrom
e790a8:main

Conversation

@e790a8
Copy link
Copy Markdown
Contributor

@e790a8 e790a8 commented Mar 24, 2026

没有完全采用AI的修复建议,原因是在文档中locate不会包含其他选项

image

e790a8 and others added 17 commits March 9, 2026 17:46
…nested format

Change the YAML image-prompt examples for aiTap/aiHover to use the
sibling `locate` format instead of the nested format. Add a note that
the legacy nested format is still supported but not recommended.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- Invert yamlWorkflow empty check so empty/undefined yamlWorkflow is
  treated as cache miss instead of valid cache
- Restore missing else branch in player.ts so actions without paramSchema
  but with string params still execute correctly

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…on dispatch

- Test matchPlanCache rejects empty/invalid flow in cached yamlWorkflow
- Test player dispatches runAdbShell/launch to agent methods directly
- Test generic string param actions route through callActionInActionSpace
- Test fallback when agent lacks runAdbShell method

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…AdbShellParam

Make the function name explicitly describe which actions it handles
(Launch and RunAdbShell) instead of using a vague "special" qualifier.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@e790a8 e790a8 changed the title feat(core): aiTap Images does not work fix(core): aiTap Images does not work Mar 24, 2026
@e790a8 e790a8 changed the title fix(core): aiTap Images does not work fix(core): aiTap Images does not work && feat(core): make the images provided by aiTap truly effective Mar 24, 2026
@e790a8
Copy link
Copy Markdown
Contributor Author

e790a8 commented Mar 24, 2026

内部使用下来,发现images普遍都不生效,AI不会采纳提供的图片,修复方案测试下来,效果不错

image

更改前
image

更改后
示例1
image

示例2
image

示例3(纯字符串)
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants