Break~ish change Latest Images - Preview of 1.0.12 #21
Closed
orneryd
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Hey all!
I needed to de-pollute the
propertiesnamespace for nodes so I moved the managed embedding information to a node struct property instead. This means you can use any property field name in Properties for the node and it won't get clobbered by anything. If you use the managed embeddings, you will probably need to re-generate them entirely or risk tomb-stoning your existing embeddings in the data files.I also moved the e2e search response time down to 7-8 ms for the entire e2e RAG retreival pipeline including embedding the string query (most production systems target <~100ms for the entire pipeline). This was tested on a dataset of 300K nodes of content translated between multiple languages (resulted in ~940K embeddings.)
IVF-HNSW scaling for 1024 dims overhead for the cluster routing breaks even somewhere between 40M-50M embeddings. For all size datasets, we auto-select strategy based on the size (tunable still) but defaults have changes based on the new search implementation.
Added
Per-database configuration and routing improvements
RBAC and access-control primitives
pkg/auth.Search/index persistence capabilities
Heimdall integration enhancements
Changed
Search architecture and performance
Config model consolidation
Cypher and query execution behavior
macOS File Indexer and app UX
Fixed
toLower, optional-match, and distinct-related paths.Docs & Developer Experience
Thanks for your bug reports and suggestions! please keep them coming ❤️
All reactions