enhance: [2.6] make function runner analyzer concurrency configurable (#50112)

[aoiasd]

relate: #50113
pr: #50112

Summary

Make function runner text tokenization concurrency configurable and let analyzer pool concurrency resize when the analyzer concurrency config changes.

[sre-ci-robot]

[ci-v2-notice]
Notice: New ci-v2 system is enabled for this PR.

To rerun ci-v2 checks, comment with:

• /ci-rerun-code-check // for ci-v2/code-check
• /ci-rerun-code-check-macos // for Code Checker MacOS (GitHub Actions)
• /ci-rerun-build // for ci-v2/build
• /ci-rerun-build-all // for ci-v2/build-all (multi-arch builds)
• /ci-rerun-buildenv // for ci-v2/build-env (build milvus-env builder images)
• /ci-rerun-ut-integration // for ci-v2/ut-integration, will rerun ci-v2/build
• /ci-rerun-ut-go // for ci-v2/ut-go, will rerun ci-v2/build
• /ci-rerun-ut-cpp // for ci-v2/ut-cpp
• /ci-rerun-ut // for all ci-v2/ut-integration, ci-v2/ut-go, ci-v2/ut-cpp, will rerun ci-v2/build
• /ci-rerun-e2e-default // for ci-v2/e2e-default
• /ci-rerun-e2e-amd // for ci-v2/e2e-amd (e2e pool dispatcher)
• /ci-rerun-build-ut-cov // for ci-v2/build-ut-cov (build + unit tests in one pipeline)
• /ci-rerun-gosdk // for ci-v2/go-sdk (Go SDK E2E tests, ARM)

If you have any questions or requests, please contact @zhikunyao.

[mergify]

@aoiasd Please associate the related issue to the body of your Pull Request. (eg. "issue: #")

[codecov]

Codecov Report

❌ Patch coverage is 78.35052% with 21 lines in your changes missing coverage. Please review.
✅ Project coverage is 77.64%. Comparing base (cb08db0) to head (82897c8).
⚠️ Report is 940 commits behind head on 2.6.

Files with missing lines	Patch %	Lines
internal/util/function/bm25_function.go	65.45%	14 Missing and 5 partials ⚠️
...rnal/util/function/multi_analyzer_bm25_function.go	88.88%	1 Missing and 1 partial ⚠️

❌ Your patch check has failed because the patch coverage (78.35%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files

@@            Coverage Diff             @@
##              2.6   #50115      +/-   ##
==========================================
+ Coverage   76.99%   77.64%   +0.65%     
==========================================
  Files        1700     1999     +299     
  Lines      262533   328465   +65932     
==========================================
+ Hits       202142   255047   +52905     
- Misses      53550    65566   +12016     
- Partials     6841     7852    +1011     

Components	Coverage Δ
Client	79.48% <74.73%> (+1.34%)	⬆️
Core	84.42% <ø> (+2.21%)	⬆️
Go	75.75% <56.51%> (+0.36%)	⬆️

Files with missing lines	Coverage Δ
pkg/util/paramtable/function_param.go	89.07% <100.00%> (+53.25%)	⬆️
...rnal/util/function/multi_analyzer_bm25_function.go	67.78% <88.88%> (+1.80%)	⬆️
internal/util/function/bm25_function.go	71.91% <65.45%> (-4.13%)	⬇️

... and 1411 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: aoiasd, zhengbuqian

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [zhengbuqian]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[sre-ci-robot]

[INFO] PR Label Summary by Default
[SUCCESS] PR #50112 merged to master

• Title: enhance: make function runner analyzer concurrency configurable
• Link: enhance: make function runner analyzer concurrency configurable #50112

[WARNING] Milestone not set

• PR: enhance: [2.6] make function runner analyzer concurrency configurable (#50112) #50115
• Title: enhance: [2.6] make function runner analyzer concurrency configurable (enhance: make function runner analyzer concurrency configurable #50112)
  Please set a milestone for better release tracking

You can set milestone by commenting:
/set-milestone
Example:
/set-milestone 2.5.0

Use /refresh-label to update related check and label manually

[aoiasd]

/set-milestone 2.6.19

[aoiasd]

/refresh-label

[sre-ci-robot]

[INFO] Set milestone to: 2.6.19

[sre-ci-robot]

[INFO] PR Label Summary by Default
[SUCCESS] PR #50112 merged to master

• Title: enhance: make function runner analyzer concurrency configurable
• Link: enhance: make function runner analyzer concurrency configurable #50112

Use /refresh-label to update related check and label manually