Skip to content

[Fix](mongodb-cdc) Fix MongoDB connection options propagation and filter system collections#672

Open
ziyanTOP wants to merge 1 commit into
apache:masterfrom
ziyanTOP:fix-mongodb-connection-options
Open

[Fix](mongodb-cdc) Fix MongoDB connection options propagation and filter system collections#672
ziyanTOP wants to merge 1 commit into
apache:masterfrom
ziyanTOP:fix-mongodb-connection-options

Conversation

@ziyanTOP
Copy link
Copy Markdown

Fixes #664

…ter system collections

This commit fixes two issues:

1. connection-options not being passed to MongoDBSourceBuilder:
   The internal Flink CDC key is \"connection.options\" (with dot), but users
   naturally pass \"connection-options\" (with hyphen). Added getConnectionOptions()
   to try both keys for compatibility. Also added .scheme() and .connectionOptions()
   calls to MongoDBSourceBuilder which were previously missing.

2. Unauthorized errors on system collections:
   MongoDB system collections (e.g. system.profile) cannot be accessed without
   elevated privileges. Added a filter to skip collections starting with \"system.\"
   during schema inference.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug](mongodb-cdc) MongoDB connection options propagation and system collection filtering

1 participant