Skip to content

Support full lookup cache for Flink Hologres connector#99

Open
460188199-code wants to merge 1 commit into
aliyun:masterfrom
460188199-code:fix-flink-119-hologres-full-cache
Open

Support full lookup cache for Flink Hologres connector#99
460188199-code wants to merge 1 commit into
aliyun:masterfrom
460188199-code:fix-flink-119-hologres-full-cache

Conversation

@460188199-code
Copy link
Copy Markdown

Summary:
Support Flink standard FULL lookup cache for the Hologres Flink connector by adding a dedicated hologres-full-cache connector identifier.

Changes:

  • Add hologres-full-cache factory for FULL lookup cache usage.
  • Keep the existing hologres connector behavior unchanged.
  • Support periodic FULL cache reload options.
  • Add source.scan.split-count to control bulk read split count and Hologres scan pressure.
  • Add tests for FULL cache factory validation and bulk read split planning.

Notes:

  • During reload, the old cache continues to serve lookup joins until the new cache finishes loading.
  • Users should avoid truncating the dimension table before reloading data, because a refresh may load an empty table and switch the cache to empty.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant