Skip to content

Reorganize query-engine languages and inline OTLP bridge#2797

Draft
marcsnid wants to merge 8 commits intoopen-telemetry:mainfrom
marcsnid:marcsnid/reorganize-query-engine-languages
Draft

Reorganize query-engine languages and inline OTLP bridge#2797
marcsnid wants to merge 8 commits intoopen-telemetry:mainfrom
marcsnid:marcsnid/reorganize-query-engine-languages

Conversation

@marcsnid
Copy link
Copy Markdown
Contributor

Change Summary

Renames the opl crate to query-engine-languages and nests OPL as a submodule inside it. Adds the OTTL parser stub (from experimental/query_engine/ottl-parser) as a second submodule, giving us a single home for language parsers going forward. Also pulls engine-recordset-otlp-bridge directly into recordset_kql_processor as a local otlp_bridge module so contrib-nodes doesn't depend on that external crate anymore.

All existing tests pass, no behavior changes.

What issue does this PR close?

How are these changes tested?

Existing unit tests cover all moved code. cargo xtask check passes (structure, fmt, clippy, full test suite).

Are there any user-facing changes?

No.

…eorganize-query-engine-languages

# Conflicts:
#	rust/otap-dataflow/crates/otap/Cargo.toml
#	rust/otap-dataflow/crates/query-engine/src/pipeline/filter.rs
@marcsnid marcsnid requested a review from a team as a code owner April 30, 2026 21:22
@github-actions github-actions Bot added rust Pull requests that update Rust code query-engine Query Engine / Transform related tasks query-engine-columnar Columnar query engine which uses DataFusion to process OTAP Batches labels Apr 30, 2026
@marcsnid marcsnid marked this pull request as draft April 30, 2026 21:26
@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 30, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 80.69%. Comparing base (74bcd98) to head (c8db8bc).

❌ Your project check has failed because the head coverage (80.69%) is below the target coverage (85.00%). You can increase the head coverage or adjust the target coverage.

❗ There is a different number of reports uploaded between BASE (74bcd98) and HEAD (c8db8bc). Click for more details.

HEAD has 5 uploads less than BASE
Flag BASE (74bcd98) HEAD (c8db8bc)
8 3
Additional details and impacted files
@@             Coverage Diff             @@
##             main    #2797       +/-   ##
===========================================
- Coverage   86.09%   80.69%    -5.40%     
===========================================
  Files         694      166      -528     
  Lines      263431    48645   -214786     
===========================================
- Hits       226788    39252   -187536     
+ Misses      36119     8869    -27250     
  Partials      524      524               
Components Coverage Δ
otap-dataflow ∅ <ø> (∅)
query_abstraction 80.61% <ø> (ø)
query_engine 89.61% <ø> (-1.16%) ⬇️
otel-arrow-go 52.45% <ø> (ø)
quiver ∅ <ø> (∅)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

…om:marcsnid/otel-arrow into marcsnid/reorganize-query-engine-languages
@github-actions github-actions Bot added query-engine-ottl OTTL usage of Query Engine query-engine-recordset Reference query engine implementation processing over a set of records labels Apr 30, 2026
…om:marcsnid/otel-arrow into marcsnid/reorganize-query-engine-languages
…om:marcsnid/otel-arrow into marcsnid/reorganize-query-engine-languages
Copy link
Copy Markdown
Contributor

@lquerel lquerel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

query-engine Query Engine / Transform related tasks query-engine-columnar Columnar query engine which uses DataFusion to process OTAP Batches query-engine-ottl OTTL usage of Query Engine query-engine-recordset Reference query engine implementation processing over a set of records rust Pull requests that update Rust code

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

Reorganize query-engine related code and language parsers

2 participants