Skip to content

Feature/adjust estimated multitest exec time based on testcase count - #1210

Merged
zhenyu-ms merged 10 commits into
morganstanley:mainfrom
zhenyu-ms:runtime-file-tweak
Jul 29, 2025
Merged

Feature/adjust estimated multitest exec time based on testcase count#1210
zhenyu-ms merged 10 commits into
morganstanley:mainfrom
zhenyu-ms:runtime-file-tweak

Conversation

@zhenyu-ms

@zhenyu-ms zhenyu-ms commented Jul 11, 2025

Copy link
Copy Markdown
Member

Bug / Requirement Description

to get better estimation of multitest exec time for improved test turnover time (more parts if more testcases) or better testing resource utilization (fewer parts if fewer testcases)

Solution description

allow extra field, i.e. total testcase count of previous run called testcase_count in runtime data file; during multitest auto-partitioning, estimated overall exec time will be adjusted by curr testcase count over prev testcase count, adjusted exec time will be written back to testrunner.cfg.runtime_data

update some type hints as well

Checklist:

  • Test
  • Example (both test_plan.py and .rst)
  • Documentation (API)
  • News fragment present for release notes
  • MS info leakage check
  • For new driver: driver index page
  • For new assertion: ui/pdf/std renderers, documentation
  • For new cmdline arg: documentation

@zhenyu-ms
zhenyu-ms requested a review from a team as a code owner July 11, 2025 10:07
@zhenyu-ms
zhenyu-ms marked this pull request as draft July 22, 2025 08:34
@zhenyu-ms
zhenyu-ms force-pushed the runtime-file-tweak branch from fd7f9d8 to 96490b0 Compare July 24, 2025 10:38
@zhenyu-ms
zhenyu-ms marked this pull request as ready for review July 25, 2025 07:27
Comment thread testplan/runnable/base.py Outdated
Comment thread testplan/runnable/base.py Outdated
Comment thread testplan/runnable/base.py Outdated
Comment thread testplan/runnable/base.py Outdated
@zhenyu-ms zhenyu-ms changed the title Feature/allow extra fields in runtime data file Feature/adjust estimated multitest exec time based on testcase count Jul 29, 2025
@zhenyu-ms
zhenyu-ms force-pushed the runtime-file-tweak branch from d3774e1 to 48a434e Compare July 29, 2025 06:30
@zhenyu-ms
zhenyu-ms force-pushed the runtime-file-tweak branch from 48a434e to df5e7b5 Compare July 29, 2025 06:31
Pyifan
Pyifan previously approved these changes Jul 29, 2025
@zhenyu-ms
zhenyu-ms merged commit f24c96f into morganstanley:main Jul 29, 2025
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants