Skip to content

[FSTORE-1970] Upgrade opensearch to 2.19.5#951

Open
jimdowling wants to merge 2 commits into
logicalclocks:mainfrom
jimdowling:opensearch-2
Open

[FSTORE-1970] Upgrade opensearch to 2.19.5#951
jimdowling wants to merge 2 commits into
logicalclocks:mainfrom
jimdowling:opensearch-2

Conversation

@jimdowling
Copy link
Copy Markdown
Contributor

Summary

  • Replaces pyjks with cryptography for JKS keystore/truststore parsing (no native build deps needed)
  • Bumps opensearch-py upper bound to <=2.8.0 (compatible with OpenSearch 2.19.5)
  • Updates KNN query syntax in VectorDbClient to the new knn.<field>.filter form supported by OpenSearch 2.19

Supersedes #835.

Test plan

  • uv run --project python pytest python/tests
  • Smoke-test vector DB similarity search against an OpenSearch 2.19.5 cluster
  • Verify cert materialization on a Hopsworks job pod (keystore/truststore → PEM)

kennethmhc and others added 2 commits February 16, 2026 08:12
…ry syntax

- Replace pyjks with built-in cryptography for JKS keystore parsing
- Implement _load_jks() to handle JKS files from all JDK versions including JDK 21+
- Update opensearch-py version constraint to support new KNN filter syntax
- Migrate vector DB queries to use knn.filter pattern for OpenSearch 2.8+
- Update Python requirement from >=3.9 to >=3.10
- Update test expectations for new query structure

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
Brings in pyjks→cryptography swap, OpenSearch 2.8 client bump, and KNN
query syntax update. Resolved conflicts in client/base.py and
client/hopsworks.py to keep `@also_available_as` decorators alongside
the new cryptography-based JKS handling, and dropped the unreachable
`_bytes_to_pem_str` (referenced an unimported `textwrap`; superseded by
`_der_to_pem`).
@github-actions
Copy link
Copy Markdown

Coverage report

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)
Lines missing
  python/hopsworks_common/client
  base.py 215, 228-297, 302-308, 321-356, 361-373, 378-380, 388-393, 397-403, 407-415
  hopsworks.py 86-92
  python/hsfs/core
  vector_db_client.py 134-139, 173-175, 192-196, 493
Project Total  

This report was generated by python-coverage-comment-action

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants