Document indexing constraints, FTS tokenizer knobs, and HNSW-quantized variants#222
Merged
Document indexing constraints, FTS tokenizer knobs, and HNSW-quantized variants#222
Conversation
…d variants Address reviewer feedback against the lancedb and sophon source repos: - Vector index: call out that IVF_FLAT + hamming is the only supported path for binary vectors, and that quantized index types restrict distance_type to l2/cosine/dot. - Vector index: note that multivector indexing requires cosine at index creation time, which is why bypass_vector_index() is the escape hatch for non-cosine multivector queries. - FTS: document custom_stop_words, min_ngram_length, max_ngram_length, and prefix_only on the FTS parameters table, plus custom_stop_words parity on the full-text-search guide. - Quantization: add IVF_HNSW_SQ and IVF_HNSW_PQ alongside IVF_PQ and IVF_RQ, and frame the two axes (IVF vs. IVF+HNSW; PQ/RQ/SQ). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Contributor
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Workflows to automatically generate PRs for you. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Addresses reviewer feedback the source code. Prose/table edits only — no snippet regeneration needed.
IVF_FLAT+hammingis the only supported path for binary vectors; quantized index types restrictdistance_typetol2/cosine/dot.cosineat index-creation time; explains whybypass_vector_index()is the escape hatch for non-cosine multivector queries.custom_stop_words,min_ngram_length,max_ngram_length, andprefix_onlyto the FTS parameters table, withcustom_stop_wordsparity on the full-text-search guide.IVF_HNSW_SQandIVF_HNSW_PQalongsideIVF_PQandIVF_RQ, and frames the two axes (IVF vs. IVF+HNSW; PQ/RQ/SQ).Test plan
mintlify dev— load each edited page; confirm tables render and cross-links resolve (/search/multivector-search,/indexing/vector-index#choose-the-right-index).fts-index.mdx.🤖 Generated with Claude Code