tl;dr

feature flag: opensearch

The vector-store is rooted in a use the Usearch library. We want to support also Opensearch as an indexing service. This issue should implement support for this.

Design

The architecture of the service is based on the actor framework. The Usearch index functionality is implemented in the index actor. The Opensearch functionality should be implemented in a separate actor. API for both should be same, only a backend should be different. There should be only one running actor, there should be an environment value to choose which index functionality should be used. All additional parameters for Opensearch should be provided by environment values. For integration tests use a mockup of Opensearch. Real integration tests should be done in a scylladb repository.

PRs

• Add opensearch feature flag #34
• Refactor the Usearch index actor. Copy a backend from index.rs into index/usearch.rs.
  • Move index.rs to index/usearch.rs #36
• Create empty backend for the Opensearch. Create backend in index/opensearch.rs.
  • Add IndexFactory and refactor engine.rs to use it #133
  • Add opensearch index: create backend for Opensearch #125
• Implement Index::Add for the Opensearch.
  • Add opensearch index: implement Index::Add for Opensearch #126
• Implement Index::Ann for the Opensearch.
  • VECTOR-74 Add Opensearch index: implement Index::Ann for Opensearch #141
• Implement other necessary functions for the OpenSearch.
  • VECTOR-74 Add Opensearch index: implement Index::Remove for Opensearch #140
  • VECTOR-74 Add Opensearch index: implement Index::Count for Opensearch #144
• Create integration tests with mockup
  • VECTOR-74: implement OpenSearch mockup #145
• Remove opensearch flag feature
  • cleanup: remove unnecessary attributes and comments #147
  • VECTOR-74: Remove opensearch feature flag #148

Migrated to Jira: VS-74