-
Notifications
You must be signed in to change notification settings - Fork 115
POC for Vespa search engine #1004
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: multi-engine
Are you sure you want to change the base?
Conversation
Signed-off-by: Michael Oviedo <[email protected]>
Signed-off-by: Michael Oviedo <[email protected]>
Signed-off-by: Michael Oviedo <[email protected]>
…uilder + worker coordinator Signed-off-by: Michael Oviedo <[email protected]>
Signed-off-by: Michael Oviedo <[email protected]>
Signed-off-by: Michael Oviedo <[email protected]>
Signed-off-by: Michael Oviedo <[email protected]>
Signed-off-by: Michael Oviedo <[email protected]>
Signed-off-by: Michael Oviedo <[email protected]>
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Comment |
Signed-off-by: Michael Oviedo <[email protected]>
Signed-off-by: Michael Oviedo <[email protected]>
…earchDataBaseClient object for telemetry operations that run synchronously before the benchmark Signed-off-by: Michael Oviedo <[email protected]>
Description
Adds POC for Vespa search engine.
Creates a unified abstraction layer for clients + runners and adds vespa client + runners
Benchmarks can be run on Vespa with appropriate configurations + schema for deploying data. Example for nyc_taxis can be found on my fork here: https://github.com/OVI3D0/opensearch-benchmark-workloads/tree/multi-engine
To tell OSB we're running on vespa, we'll use a new
--database-typeargument. If not provided, OSB will assume we're running against an opensearch cluster. Otherwise, you can tell OSB to benchmark using vespa client + runners by adding--database-type=vespato your benchmark command.Issues Resolved
#1000
Testing
Still seems to be some issues with indexing due to 429 errors but I'm able to run a full benchmark E2E:
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.