Skip to content

Notebook - OpenSearch embedding enrichment #102

Merged
andy-k-improving merged 7 commits intomainfrom
ft-hf-oss-embedding-enrichment
Mar 24, 2026
Merged

Notebook - OpenSearch embedding enrichment #102
andy-k-improving merged 7 commits intomainfrom
ft-hf-oss-embedding-enrichment

Conversation

@andy-k-improving
Copy link
Copy Markdown
Contributor

@andy-k-improving andy-k-improving commented Mar 10, 2026

Summary 📝

Write an overview about it.
This PR aims to introduce a new notebook to demonstrate how to perform embedding data enrichment with OpenSearch service.

Also a small update has been made on util.py to simplify the embedding handling.

Support for knn_vector:
awslabs/aws-athena-query-federation#3315
awslabs/aws-athena-query-federation#3316

Test plan:

Permissions

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@andy-k-improving andy-k-improving marked this pull request as ready for review March 10, 2026 23:21
Comment thread nx_neptune/utils/utils.py
Copy link
Copy Markdown
Contributor

@acarbonetto acarbonetto left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great. Thanks Andy.

"\n",
"The connector does not yet support the native knn_vector field type in OpenSearch. Queries against indices containing knn_vector fields may fail during schema resolution.\n",
"\n",
"Support for the native knn_vector type is currently under development.\n",
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you can link to the issue and then when it's complete, we can update the notebook

Comment thread notebooks/import_open_search_embedding_demo.ipynb
@andy-k-improving andy-k-improving merged commit f1f6084 into main Mar 24, 2026
8 checks passed
@andy-k-improving andy-k-improving deleted the ft-hf-oss-embedding-enrichment branch April 8, 2026 23:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants