Skip to content

logsource: delay source wakeup#1096

Open
bazsi wants to merge 1 commit into
axoflow:mainfrom
bazsi:logsource-delay-wakeup-to-improve-batching
Open

logsource: delay source wakeup#1096
bazsi wants to merge 1 commit into
axoflow:mainfrom
bazsi:logsource-delay-wakeup-to-improve-batching

Conversation

@bazsi
Copy link
Copy Markdown
Member

@bazsi bazsi commented May 28, 2026

This is another batching improvement to increase the source-side batches. Instead of waking up the source immediately after a single message becomes available, wait up to 100 messages to be drained from the window and then wakup the source.

This removes the pressure on iv_event_post() in the ivykis mainloop, as well as generating larger batches in LogScheduler, reducing log contention and latency.

Comment thread lib/logsource.c Outdated
Comment thread lib/logsource.c
@bazsi bazsi force-pushed the logsource-delay-wakeup-to-improve-batching branch 3 times, most recently from 160f88c to a46731d Compare May 29, 2026 21:21
Do not wakeup the source immediately once the first slot in the window
becomes available, rather wait roughly a batch, so the source can iterate on
multiple messages, instead of just one.

Assisted-by: Claude:claude-opus-4-7
Signed-off-by: Balazs Scheidler <balazs.scheidler@axoflow.com>
@bazsi bazsi force-pushed the logsource-delay-wakeup-to-improve-batching branch from a46731d to 4c5c4fc Compare May 30, 2026 14:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants