Skip to content

feat(core): add configurable text input strategies - #3042

Merged
quanru merged 6 commits into
mainfrom
feat/ai-input-strategy
Aug 28, 2026
Merged

feat(core): add configurable text input strategies#3042
quanru merged 6 commits into
mainfrom
feat/ai-input-strategy

Conversation

@quanruzhuoxiu

Copy link
Copy Markdown
Collaborator

Summary

  • add inputStrategy: 'legacy' | 'sequential' | 'bulk' to aiInput, YAML input actions, and platform-level defaults
  • keep legacy as the compatibility-safe default while allowing explicit Unicode code-point input or one-operation bulk input
  • support Web, Chrome Extension/Bridge, Android, iOS, HarmonyOS, local Computer, and RDP backends
  • make Web bulk replacement select the existing value and use insertText, producing one insertion event instead of clear-plus-character events
  • validate layered action/platform options before mutating an input field and reject invalid delay combinations with actionable errors
  • document the behavior in English and Chinese

Validation

  • pnpm run lint
  • npx nx test @midscene/core -- tests/unit-test/action-param-validation.test.ts tests/unit-test/device-options.test.ts tests/unit-test/player-action-dispatch.test.ts tests/unit-test/prompt/planning/action-description.test.ts
  • npx nx test @midscene/web -- tests/unit-test/web-actions-navigation.test.ts tests/unit-test/puppeteer/input-clear-then-type-race.test.ts
  • npx nx test @midscene/android -- tests/unit-test/page.test.ts
  • npx nx test @midscene/ios -- tests/unit-test/device.test.ts
  • npx nx test @midscene/harmony -- tests/unit-test/device.test.ts
  • npx nx test @midscene/computer -- tests/unit-test/input-strategy.test.ts tests/unit-test/rdp/agent.test.ts tests/unit-test/agent-tools.test.ts
  • npx nx build @midscene/core
  • npx nx build @midscene/web
  • npx nx build @midscene/android
  • npx nx build @midscene/ios
  • npx nx build @midscene/harmony
  • npx nx build @midscene/computer

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Aug 26, 2026

Copy link
Copy Markdown

Deploying midscene with  Cloudflare Pages  Cloudflare Pages

Latest commit: 41417c6
Status: ✅  Deploy successful!
Preview URL: https://12e61bfe.midscene.pages.dev
Branch Preview URL: https://feat-ai-input-strategy.midscene.pages.dev

View logs

@quanru
quanru merged commit 18c5d9e into main Aug 28, 2026
3 of 16 checks passed
@quanru
quanru deleted the feat/ai-input-strategy branch August 28, 2026 09:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants