Skip to content
This repository was archived by the owner on Jan 24, 2024. It is now read-only.

Handle requests before and during a migration #1517

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

ZiyaoWei
Copy link
Contributor

Master Issue: #1475

Motivation

If a topic is configured with migration,

  • Before the migration starts, data requests for it should be proxied to the backing Kafka instance.
  • While the migration is ongoing, all requests should return errors.

Modifications

Add proxying logic for data requests before the migration, also return REBALANCE_IN_PROGRESS during a migration.

Verifying this change

  • Make sure that the change passes the CI checks.

Tests WIP; will add integration tests eventually but probably in a few separate PRs, probably will begin with a few shell scripts that demonstrates the functionality.

Documentation

Check the box below.

Need to update docs?

  • doc-required

@github-actions
Copy link

@ZiyaoWei:Thanks for your contribution. For this PR, do we need to update docs?
(The PR template contains info about doc, which helps others know more about the changes. Can you provide doc-related info in this and future PR descriptions? Thanks)

@github-actions github-actions bot added the doc-info-missing This pr needs to mark a document option in description label Sep 29, 2022
@ZiyaoWei ZiyaoWei changed the title Wzy migration proxy Handle requests before and during a migration Sep 29, 2022
@ZiyaoWei ZiyaoWei force-pushed the wzy-migration-proxy branch 3 times, most recently from 8dbeefa to 6cbbc5b Compare October 6, 2022 00:46
@ZiyaoWei ZiyaoWei force-pushed the wzy-migration-proxy branch 4 times, most recently from 5c2d413 to 51345d6 Compare October 11, 2022 04:01
@ZiyaoWei ZiyaoWei force-pushed the wzy-migration-proxy branch from 51345d6 to bf222f5 Compare October 12, 2022 01:58
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
doc-info-missing This pr needs to mark a document option in description
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant