Skip to content

perf: 大批量主机任务启动耗时过长 #4371

Description

@jsonwan

在某些环境中,超过1w主机的任务启动耗时超过30s,相关日志如下:

23175:[2026-06-24 14:10:34.823]  WARN [job-execute,bb79a6c885763badcfa7b5afdc827c47,52c1d63c5f5d4c74] 7 --- [http-nio-19804-exec-12] c.t.b.j.e.s.impl.TaskExecuteServiceImpl  : CreateTaskInstanceFast is slow, statistics: StopWatch 'executeFastTask': 40.266450395 seconds
23176--------------------------------------------------
23177-Seconds       %       Task name
23178--------------------------------------------------
23179-00.00359992   00%     checkRunningJobQuoteLimit
23180-00.00293234   00%     checkAndSetAccountInfo
23181-00.9821987    02%     processExecuteObjects
23182-00.00047466   00%     checkStepInstance
23183-00.01743381   00%     authFastExecute
23184-00.57249253   01%     saveInstance
23185-38.00243972   94%     saveTaskInstanceHosts
23186-00.67878582   02%     saveRollingConfig
23187-00.00390318   00%     addRunningJobResourceQuota
23188-00.0018659    00%     saveOperationLog
23189-00.00032381   00%     startJob

主要耗时在于saveTaskInstanceHosts阶段,优化方向:

  1. Issue_1697的优化被后续修改覆盖,需要重新看下是否将rewriteBatchedStatements参数放到values默认值中;
    perf: 作业包含大量主机,执行作业请求响应时间过长 #1697
  2. saveTaskInstanceHosts操作保存的任务-主机关系数据主要用于搜索,非核心流程,可以考虑做成异步的。

Metadata

Metadata

Assignees

No one assigned

    Labels

    backlog需求初始状态,等待产品进行评估kind/enhancement功能改进特性

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions