Skip to content

search: fix trace fragmentation and restructure spans - #6620

Merged
loutPhilipps merged 4 commits into
mainfrom
lout.philipps/search-tracing-spans
Jul 31, 2026
Merged

search: fix trace fragmentation and restructure spans#6620
loutPhilipps merged 4 commits into
mainfrom
lout.philipps/search-tracing-spans

Conversation

@loutPhilipps

Copy link
Copy Markdown
Contributor

Restructures search spans so a distributed search forms one coherent tree instead of fragmented, collinear siblings:

  • nest per-split spans under multi_index_leaf_search
  • add more granularity: plan_splits_for_root_search, list_relevant_splits, fetch_docs_in_split, and a per-split wrapper (leaf_search_single_split_wrapper) so each split's wait + warmup + tantivy form one subtree
  • split the CPU-pool queue wait out of tantivy_search into waiting_for_cpu_pool
  • surface search_partial_hits_phase so all leaves group under one node

- nest per-split spans under `multi_index_leaf_search`
- add more granularity: `plan_splits_for_root_search`, `list_relevant_splits`,
  `fetch_docs_in_split`, and a per-split wrapper (`leaf_search_single_split_wrapper`)
  so each split's wait + warmup + tantivy form one subtree
- split the CPU-pool queue wait out of `tantivy_search` into `waiting_for_cpu_pool`
- surface `search_partial_hits_phase` to have all leaves as children
Comment thread quickwit/quickwit-search/src/leaf.rs Outdated
@loutPhilipps
loutPhilipps marked this pull request as ready for review July 23, 2026 15:21
@loutPhilipps
loutPhilipps requested a review from a team as a code owner July 23, 2026 15:21
@loutPhilipps
loutPhilipps requested a review from guilload July 23, 2026 15:21
Comment thread quickwit/quickwit-search/src/leaf.rs Outdated
Comment thread quickwit/quickwit-search/src/leaf.rs Outdated
Comment thread quickwit/quickwit-search/src/leaf.rs Outdated
Co-authored-by: Adrien Guillo <adrien.guillo@gmail.com>
@loutPhilipps
loutPhilipps enabled auto-merge (squash) July 30, 2026 16:18
@loutPhilipps
loutPhilipps merged commit e69c2c1 into main Jul 31, 2026
9 checks passed
@loutPhilipps
loutPhilipps deleted the lout.philipps/search-tracing-spans branch July 31, 2026 08:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants