Open
Description
Meta issue: #121652
The initial implementation of FORK will be under snapshot and will have the following restrictions:
- First level data retrieval only - not yet general purpose bifurcation of the stream. This allows us to support multiple different subqueries. For bifurcation of the stream, then the planner will have to determine that the fork is actually being performed in second stage retrieval. This is a pragmatic limitation that we can lift later.
- All branches of the fork must return the same data scheme (same columns). This is a pragmatic limitation that we can lift later. For this reason, only WHERE, SORT, and LIMIT, are supported within fork subqueries.
- No fork within a fork. This is a pragmatic limitation that we can lift later.
- Lucene queries are independent - no point-in-time. We can add this later
- Fork branches are automatically named. We can provide the ability to name the branches later.
Tasks:
- ES|QL: Initial grammar and changes for FORK (snapshot) #121948
- streaming results from subplans, rather than using the Inline stats trick from EsqlSession Streaming execution for FORK #126389
- support queries using semantic search ES|QL: Enable semantic search in FORK #125960
- optimize field resolution so we don't return all fields when FORK is used (see
fieldNamesinEsqlSession) ES|QL: Make Fork n-ary #126074 - add verification and metric gathering for subplans ES|QL: Make Fork n-ary #126074
- fix nesting of commands-names in expressions (see testCommandNamesAsIdentifiersWithLimit)
- revisit the use of explicit analyser rules, e.g. ImplicitForkCasting, etc, with the intention of generalising them (rather than an explicit "fork variant" for each rule) ES|QL: Make Fork n-ary #126074
- validation when using more than a single FORK Initial FORK with restrictions #121950
- make sure the profile information contains all drivers and that they are properly tagged with the fork branch identifier
- ES|QL: tests for FORK's evaluation of field names used in field_caps resolve calls #127208
- fix CCS support ES|QL: Skip FORK tests for CCS for now #127309
- ES|QL: Fix column references for FORK #127209