Skip to content

(DELAY MERGE) Feat[mqbs] FSM mode: add dynamic partition resize during rollover#1215

Open
alexander-e1off wants to merge 4 commits into
bloomberg:mainfrom
alexander-e1off:enable-resize-partition
Open

(DELAY MERGE) Feat[mqbs] FSM mode: add dynamic partition resize during rollover#1215
alexander-e1off wants to merge 4 commits into
bloomberg:mainfrom
alexander-e1off:enable-resize-partition

Conversation

@alexander-e1off

Copy link
Copy Markdown
Collaborator

Follow up of #1214. Add logic of dynamic partition resize during rollover (issue RESIZE record).

Signed-off-by: Aleksandr Ivanov <aivanov71@bloomberg.net>
Signed-off-by: Aleksandr Ivanov <aivanov71@bloomberg.net>
Signed-off-by: Aleksandr Ivanov <aivanov71@bloomberg.net>
Signed-off-by: Aleksandr Ivanov <aivanov71@bloomberg.net>
@alexander-e1off alexander-e1off marked this pull request as ready for review March 27, 2026 09:23
@alexander-e1off alexander-e1off requested a review from a team as a code owner March 27, 2026 09:23
@kaikulimu kaikulimu changed the title Feat[mqbs] FSM mode: add dynamic partition resize during rollover (DELAY MERGE) Feat[mqbs] FSM mode: add dynamic partition resize during rollover Mar 27, 2026
@kaikulimu

kaikulimu commented Apr 8, 2026

Copy link
Copy Markdown
Collaborator

Copying some comments from #1060, three things to check:

  1. On initial startup, primary takes max size from file header. Then, during rollover where grow is needed, primary will renews its max size with the configured. Then, on a future rollover where the file sizes can shrink, it will shrink to the updated file sizes derived from the config.

  2. Edge case: If primary's grow limit is lesser than replica's max file size, double check replica can correctly reduce its size.

  3. Also, the override max file sizes might be broken if replica is ahead a rollover of the primary and has different max files, through the ReplicaDataRequestPull workflow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants