Skip to content

feat: Phase 3d+3e — ParquetMergePipeline supervisor + publisher feedback #6354

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
g-talbot wants to merge 2 commits into
base: gtt/parquet-merge-pipeline-3c
Choose a base branch
from
Open

feat: Phase 3d+3e — ParquetMergePipeline supervisor + publisher feedback #6354

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
cbd56e5
feat: add ParquetMergePipeline supervisor and publisher feedback (Pha…
g-talbot Apr 29, 2026
804e384
fix: nightly rustfmt import ordering in parquet_merge_pipeline
g-talbot Apr 29, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions quickwit/quickwit-indexing/src/actors/log_publisher_impl.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,10 @@ impl Handler<DisconnectMergePlanner> for Publisher {
) -> Result<(), ActorExitStatus> {
info!("disconnecting merge planner mailbox");
self.merge_planner_mailbox_opt = None;
#[cfg(feature = "metrics")]
{
self.parquet_merge_planner_mailbox_opt = None;
}
Ok(())
}
}
Expand Down
2 changes: 2 additions & 0 deletions quickwit/quickwit-indexing/src/actors/metrics_pipeline/mod.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@ mod parquet_doc_processor;
mod parquet_indexer;
mod parquet_merge_executor;
pub(crate) mod parquet_merge_messages;
mod parquet_merge_pipeline;
mod parquet_merge_planner;
mod parquet_merge_split_downloader;
mod parquet_packager;
Expand All @@ -50,6 +51,7 @@ pub use parquet_doc_processor::{
pub use parquet_indexer::{ParquetIndexer, ParquetIndexerCounters, ParquetSplitBatch};
pub use parquet_merge_executor::ParquetMergeExecutor;
pub use parquet_merge_messages::{ParquetMergeScratch, ParquetMergeTask, ParquetNewSplits};
pub use parquet_merge_pipeline::{ParquetMergePipeline, ParquetMergePipelineParams};
pub use parquet_merge_planner::ParquetMergePlanner;
pub use parquet_merge_split_downloader::ParquetMergeSplitDownloader;
pub use parquet_packager::{ParquetBatchForPackager, ParquetPackager, ParquetPackagerCounters};
Expand Down
Loading
Loading