v2.5.7

What's Changed

• MB-69654: Fix vector field alias validation by @CascadingRadium in #2259
• Used iota for scorch EventKind by @capemox in #2257
• Fix String API for SearchResult by @CascadingRadium in #2262
• MB-55637: Added new error types in scorch by @capemox in #2255
• Add documentation for multi-vector and nested-vector field support by @CascadingRadium in #2261
• Add coverage (goveralls) github action by @abhinavdangeti in #2263
• MB-69641: Add support for retrieval of multi-vector documents by @CascadingRadium in #2258
• MB-69655: Fix vector normalization to handle multi-vectors correctly by @CascadingRadium in #2264

Milestone: https://github.com/blevesearch/bleve/milestone/33
Full Changelog: v2.5.6...v2.5.7

v2.5.6

What's Changed

• (feat) Add prefix and regex filtering for term facets by @ajroetker in #2242
• Minor code optimizations around allocations by @abhinavdangeti in #2247
• MB-60401: Perf optimizations for score fusion during hybrid search by @capemox in #2246
• Minor code fixes around recycling data structures and metric tracking by @CascadingRadium in #2252

Milestone: https://github.com/blevesearch/bleve/milestone/32
Full Changelog: v2.5.5...v2.5.6

v2.5.5

What's Changed

• MB-66396: Index APIs for TermFrequencies and CentroidCardinalities by @abhinavdangeti in #2207
• Fix BooleanFilter Logic by @CascadingRadium in #2239
• Update docs/vectors.md on new blevesearch/faiss version to use by @abhinavdangeti in #2240
• Minor Fixes by @CascadingRadium in #2241

Milestone: https://github.com/blevesearch/bleve/milestone/31
Full Changelog: v2.5.4...v2.5.5

v2.5.4

What's Changed

• MB-66576: Replace golang/protobuf with google.golang.org/protobuf by @abhinavdangeti in #2205
• MB-67212: Supporting search_after/search_before for deep pagination over non textual content by @capemox in #2208
• refactor: use slices.Equal to simplify code by @houpo-bob in #2211
• Add pagination documentation by @capemox in #2216
• Fix spelling and grammatical errors using codespell by @kianmeng in #2219
• MB-65170: Add filter support to BooleanQuery by @CascadingRadium in #2220
• Guidelines for search index creation to support auto complete / suggestions by @maneuvertomars in #2217
• Open-api spec for bleve queries by @abhinavdangeti in #2226
• MB-57888: Support for downtime mitigation upon updates to index mapping by @Likith101 in #2106
• MB-60401: Support RRF for hybrid search by @capemox in #2218
• MB-60401: Adding Relative Score Fusion by @capemox in #2233
• MB-60401: Documentation for Hybrid search's score fusion by @capemox in #2235

New Contributors

• @capemox made their first contribution in #2208
• @maneuvertomars made their first contribution in #2217

Milestone: https://github.com/blevesearch/bleve/milestone/28
Full Changelog: v2.5.3...v2.5.4

v2.5.3

Bug Fixes

• Address a performance regression in GeoShape queries introduced in v2.5.1 and affects v2.5.2 as well. This is captured in #2210. The fix blevesearch/geo#28 has been included with #2214.

Milestone

• v2.5.3

v2.5.2

Bug Fixes

• Fix handling multiple geoshapes within a single field (blevesearch/zapx#331)
• Fix sorting over decoded geo metrics (#2198)
• Fix advance() corner case within optimized composite searchers (#2146)
• Address edge case in merge planning with concurrent persisters (#2200)

Milestone

• v2.5.2

v2.5.1

Bug Fixes

• Fix bolt snapshot when concurrent persister is in use (not ON by default), with #2178
• No partial failures allowed during "pre search" - applicable to synonyms, filtered vector search - #2179
• Ensuring latest snapshot is persisted within bolt to avoid any chance of data loss (in parlance with num_snapshots_to_keep, rollback support) - #2183, #2186
• Recalculation of bm25 metrics upon every request can cause slowness, fixed with #2180
• Fixes around a tracked "pre search metric", knn filter query validation and a bad situation with synonyms if legacy zap versions used, with #2188, #2191, #2192

Improvements

• Upgrade forked version of golang/geo in use for geopoint and geoshape data to the latest available
• Enhanced geoshape support over:
  • point/multipoint, blevesearch/geo#18
  • linestring/multilineString, blevesearch/geo#19
  • polygon/multipolygon, blevesearch/geo#20
  • circle, blevesearch/geo#25
  • envelope, blevesearch/geo#21
• Circles can be included within geometry collections with #2195, blevesearch/geo#27

Milestone

• v2.5.1

v2.5.0

Bug Fixes

• Exact hits to score higher than fuzzy hits, with #2056
• Fix boosting during hybrid search that involves text + nearest neighbor, with #2127
• Addressed bug in IP field handling while highlighting, with #2142
• Graceful error handling within registry, with #2151
• http/ package (meant for demo purposes) removed from repository to remove vulnerability - CVE-2022-31022, relocated to within https://github.com/blevesearch/bleve-explorer
• Geo radius queries will now advertise distances (within sort values) in readable format, with #2137

Improvements

• Vector search requires faiss dynamic library to be built from blevesearch/faiss@352484e which is a modified version of v1.10.0
• Support for BM25 scoring, see: scoring.md
• Support for synonyms' search, see: synonyms.md
• Significant performance improvements in pre-filtered vector search, with #2169 + dependent changes
• auto fuzziness detection with #2060
• Ability to affect ingestion/drain rate by tuning persister workers with #2100
• Additional config in merge policy for improved merger behavior, with #2134
• Geo improvements: footprint reduction for polygons, better validation and graceful error handling, with #2162 + #2158 + #2165
• Upgrade to RoaringBitmap/[email protected], etcd.io/[email protected]
• More metrics

Milestone

• v2.5.0

v2.4.4

Bug Fixes

• Identified root cause for #1662 to be recycling of TermFieldReaders that was causing illegal/incorrect access of several in-memory structures in certain scenarios. We've gone ahead and disabled this feature with #2117 + #2121 . Will work towards re-enabling in the near future once we've ironed out the several associated wrinkles.
• Introduced a guard rail with blevesearch/zapx#282 while performing vector search queries with pre-filtering to avoid hitting a panic when qualified docs do not hold valid vector fields.
• Fixed an issue while applying ivf_max_codes_pct in vector search requests involving pre-filtering which can cause reduction in recall - blevesearch/go-faiss#40

Vector search continues to require same version of faiss dynamic library (as with v2.4.3) to be built from blevesearch/faiss@b747c55a which is a modified version of v1.8.0

Milestone

• v2.4.4

v2.4.3

Bug Fixes

• Address a corner case with ivf_nprobe_pct query parameter (blevesearch/go-faiss#34)
• Several guard rails put in place to avoid array-out-of-bounds-access and divide-by-zero errors: (blevesearch/zapx#263, blevesearch/zapx#270, blevesearch/zapx#271, blevesearch/zapx#273) to overcome #1662
• Handling early exits/optimization for boolean queries (#2065)

Improvements

• Vector search requires faiss dynamic library to be built from blevesearch/faiss@b747c55a which is a modified version of v1.8.0
• Support for cosine similarity distance metric to normalize vectors before indexing/querying for nearest neighbor search (#2051)
• Support for selectivity filters as a pre-cursor to vector search (#2063)

Milestone

• v2.4.3