Commit 88263de
committed
[Feature](mongodb-cdc) Expose split-related CDC options for MongoDB
Expose additional MongoDB CDC source options that were previously not
configurable in mongodb-sync-database:
- scan.incremental.snapshot.chunk.size.mb
- scan.incremental.snapshot.chunk.samples
- split.meta.group.size
- close.idle.readers
- scan.full-changelog
- scan.cursor.no-timeout
These options allow users to control snapshot chunk granularity and
reader behavior, which is especially useful for large collections.1 parent dd4b7ef commit 88263de
1 file changed
Lines changed: 25 additions & 0 deletions
File tree
- flink-doris-connector/flink-doris-connector-flink1/src/main/java/org/apache/doris/flink/tools/cdc/mongodb
Lines changed: 25 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
86 | 86 | | |
87 | 87 | | |
88 | 88 | | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
89 | 101 | | |
90 | 102 | | |
91 | 103 | | |
| |||
222 | 234 | | |
223 | 235 | | |
224 | 236 | | |
| 237 | + | |
| 238 | + | |
| 239 | + | |
| 240 | + | |
| 241 | + | |
| 242 | + | |
| 243 | + | |
| 244 | + | |
| 245 | + | |
| 246 | + | |
| 247 | + | |
| 248 | + | |
| 249 | + | |
225 | 250 | | |
226 | 251 | | |
227 | 252 | | |
| |||
0 commit comments