Makefile: add more bench-* targets for performance suite#22158
Makefile: add more bench-* targets for performance suite#22158Somesh42 wants to merge 2 commits into
Conversation
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: Somesh42 The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
Hi @Somesh42. Thanks for your PR. I'm waiting for a etcd-io member to verify that this patch is reasonable to test. If it is, they should reply with Regular contributors should join the org to skip this step. Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
| BENCHMARK_NAME="$1" | ||
| ARGS="${*:2}" | ||
|
|
||
| resolve_benchmark_bin() { |
| # limitations under the License. | ||
|
|
||
| # This script runs a benchmark on a locally started etcd server | ||
| # This script runs a benchmark against a locally started etcd server. |
Extend the existing make bench-put workflow with additional make targets for range, txn-put, stm, lease-keepalive, watch, and watch-latency. Document usage in tools/benchmark/README.md. Signed-off-by: Somesh Kumar Gouda <someshkumargauda@gmail.com>
|
@serathius removed the benchmark_test.sh changes. |
|
Think we can add all benchmarks, however I think they need to be redesigned and updated to be more reflecting for performance dimensions we care about. See #16467 (comment) section about etcd SLI /ok-to-test |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted filessee 37 files with indirect coverage changes @@ Coverage Diff @@
## main #22158 +/- ##
==========================================
- Coverage 69.77% 69.68% -0.09%
==========================================
Files 449 449
Lines 38208 38188 -20
==========================================
- Hits 26660 26613 -47
- Misses 10122 10140 +18
- Partials 1426 1435 +9 Continue to review full report in Codecov by Harness.
🚀 New features to boost your workflow:
|
Signed-off-by: Somesh Kumar Gouda <someshkumargauda@gmail.com> Signed-off-by: Somesh Kumar Gouda <someshkumargauda@gmail.com>
|
/test pull-etcd-markdown-lint |
Thanks @serathius.. makes sense. For follow-up, I'll look at #16467 (SLI section) and propose dedicated |
|
All required checks are green now (including markdown-lint and the earlier grpcproxy flake). |
Summary
Extends the existing
make bench-put/scripts/benchmark_test.shpath from #16467instead of introducing a separate benchmark suite tool.
maketargets for additional workloads:bench-range,bench-txn-put,bench-stm,bench-lease-keepalive,bench-watch,bench-watch-latencybench-put: build etcd, installbenchmarkif needed,start a temporary local etcd, run the workload with
--report-perfdash, tear downscripts/benchmark_test.shso it resolves thebenchmarkbinary fromPATH,$(go env GOPATH)/bin, or./bin/tools/benchmarktools/benchmark/README.mdThis is a follow-up to maintainer feedback that new performance work should expand
the existing benchmarking workflow rather than add another runner.
Fixes: (open/link related issue if any; otherwise reference #16467)
Test plan
make bench-put ARGS='--total=1000'make bench-range ARGS='--total=1000'make bench-txn-put ARGS='--total=1000'make bench-stm ARGS='--total=1000'make bench-lease-keepalive ARGS='--total=1000'benchmarkis found when installed under$(go env GOPATH)/binbut not onPATH