feat: add LanceDB benchmark support (IVF_FLAT, IVF_PQ, IVF_HNSW_SQ)#633
Open
fightBoxing wants to merge 1 commit into
Open
feat: add LanceDB benchmark support (IVF_FLAT, IVF_PQ, IVF_HNSW_SQ)#633fightBoxing wants to merge 1 commit into
fightBoxing wants to merge 1 commit into
Conversation
- Add LanceDB algorithm wrapper (module.py) with three index types - Add config.yml with parameter grids for euclidean/angular metrics - Add Dockerfile based on ann-benchmarks base image - Add lancedb to CI workflow (benchmarks.yml) - Add LanceDB to README Evaluated list and Results section - Include benchmark result plots for random-xs-20 datasets
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add LanceDB vector database benchmark support with three index types.
Changes
ann_benchmarks/algorithms/lancedb/module.py: LanceDB algorithm wrapper implementing the BaseANN interface with IVF_FLAT, IVF_PQ, and IVF_HNSW_SQ index typesann_benchmarks/algorithms/lancedb/config.yml: Parameter grids for euclidean and angular distance metricsann_benchmarks/algorithms/lancedb/Dockerfile: Docker image based on ann-benchmarks base.github/workflows/benchmarks.yml: Add lancedb to CI matrixREADME.md: Add LanceDB to Evaluated list and Results sectionresults/random-xs-20-*.png: Benchmark result plots for both euclidean and angular datasetsTest Results
Verified on random-xs-20 datasets (2-core OpenCloudOS 8.10 machine):
LanceDB is an embedded vector database that requires no separate server process, making integration simpler than other vector DBs (Qdrant, Milvus, etc.)