Skip to content

Commit caf24ce

Browse files
authored
[REVIEW] Add OpenSearch backend to cuvs-bench (#2012)
Would still like to refine a bit but pushing up for early feedback cc @singhmanas1 @janakivamaraju @afourniernv xref #1907 which does something similar but for Elastic EDIT: Okay, this is now ready for review (cc @jnke2016) Authors: - James Bourbeau (https://github.com/jrbourbeau) - Corey J. Nolet (https://github.com/cjnolet) Approvers: - Joseph Nke (https://github.com/jnke2016) - Corey J. Nolet (https://github.com/cjnolet) - James Lamb (https://github.com/jameslamb) URL: #2012
1 parent 4addf4e commit caf24ce

15 files changed

Lines changed: 1691 additions & 75 deletions

conda/environments/bench_ann_cuda-129_arch-aarch64.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -37,6 +37,7 @@ dependencies:
3737
- ninja
3838
- nlohmann_json>=3.12.0
3939
- openblas
40+
- opensearch-py>=2.4.0
4041
- pandas
4142
- pylibraft==26.8.*,>=0.0.0a0
4243
- pyyaml

conda/environments/bench_ann_cuda-129_arch-x86_64.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,7 @@ dependencies:
4040
- ninja
4141
- nlohmann_json>=3.12.0
4242
- openblas
43+
- opensearch-py>=2.4.0
4344
- pandas
4445
- pylibraft==26.8.*,>=0.0.0a0
4546
- pyyaml

conda/environments/bench_ann_cuda-132_arch-aarch64.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -37,6 +37,7 @@ dependencies:
3737
- ninja
3838
- nlohmann_json>=3.12.0
3939
- openblas
40+
- opensearch-py>=2.4.0
4041
- pandas
4142
- pylibraft==26.8.*,>=0.0.0a0
4243
- pyyaml

conda/environments/bench_ann_cuda-132_arch-x86_64.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,7 @@ dependencies:
4040
- ninja
4141
- nlohmann_json>=3.12.0
4242
- openblas
43+
- opensearch-py>=2.4.0
4344
- pandas
4445
- pylibraft==26.8.*,>=0.0.0a0
4546
- pyyaml

conda/recipes/cuvs-bench-cpu/recipe.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -94,6 +94,7 @@ requirements:
9494
- h5py ${{ h5py_version }}
9595
- matplotlib-base>=3.9
9696
- numpy >=1.23,<3.0
97+
- opensearch-py>=2.4.0
9798
- pandas
9899
- pyyaml
99100
- python

conda/recipes/cuvs-bench/recipe.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -47,6 +47,7 @@ requirements:
4747
- h5py ${{ h5py_version }}
4848
- libcuvs-bench-ann =${{ version }}
4949
- matplotlib-base>=3.9
50+
- opensearch-py>=2.4.0
5051
- pandas
5152
- pylibraft =${{ minor_version }}
5253
- python

dependencies.yaml

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@ files:
3535
includes:
3636
- bench
3737
- bench_python
38+
- bench_python_opensearch
3839
- build_cython
3940
- build_py_cuvs
4041
- clang
@@ -213,6 +214,14 @@ files:
213214
table: project
214215
includes:
215216
- bench_python
217+
py_opensearch_cuvs_bench:
218+
output: pyproject
219+
pyproject_dir: python/cuvs_bench
220+
extras:
221+
table: project.optional-dependencies
222+
key: opensearch
223+
includes:
224+
- bench_python_opensearch
216225
channels:
217226
- rapidsai-nightly
218227
- rapidsai
@@ -577,6 +586,11 @@ dependencies:
577586
- output_types: [requirements, pyproject]
578587
packages:
579588
- matplotlib>=3.9
589+
bench_python_opensearch:
590+
common:
591+
- output_types: [conda, pyproject]
592+
packages:
593+
- opensearch-py>=2.4.0
580594
depends_on_cuda_python:
581595
specific:
582596
- output_types: [conda, requirements, pyproject]

python/cuvs_bench/cuvs_bench/backends/__init__.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,10 +25,12 @@
2525
)
2626

2727
from .cpp_gbench import CppGoogleBenchmarkBackend
28+
from .opensearch import OpenSearchBackend
2829

2930
# Auto-register built-in backends
3031
_registry = get_registry()
3132
_registry.register("cpp_gbench", CppGoogleBenchmarkBackend)
33+
_registry.register("opensearch", OpenSearchBackend)
3234

3335
__all__ = [
3436
# Base classes and data structures
@@ -43,4 +45,5 @@
4345
"get_backend",
4446
# Built-in backends
4547
"CppGoogleBenchmarkBackend",
48+
"OpenSearchBackend",
4649
]

0 commit comments

Comments
 (0)