[Meta] Benchmark-cli improvements #12785
Description
While testing changes made to add functionality to the benchmark cli tool, there are some issues with the current state of the tool, and it will require some work to bring it up to full usefulness. This meta issue is intended to capture the work required to bring this tool into a more usable state..
- Benchmark CLI does not download releases after JDK was bundled Benchmarking Tool does not download releases after bundled JDK was available #12774
- Benchmark CLI should pass unit/integration tests
- CI should be enabled for Benchmark CLI
- Distributable should be delivered with the whole logstash distributable artifact? [benchmark tools] check distributable artifact to match libraries to the script #12920