Commit df993b0
段晓雄
fix(sink): force emitDownstream=true for Flink 2.2 two-phase commit
Flink 2.2 SinkWriterOperator sets emitDownstream based on whether the
sink implements SupportsCommitter. Paimon uses the older
TwoPhaseCommittingSink interface, causing emitDownstream=false and
committables to be silently discarded. This results in data files
written to storage but no snapshot/manifest created, making data
unqueryable.
Fix: after wrapping SinkWriterOperator, force emitDownstream=true and
fill committableSerializer via reflection when the sink supports
two-phase commit but does not implement SupportsCommitter.
Made-with: Cursor1 parent 2ea3fe0 commit df993b0
1 file changed
Lines changed: 48 additions & 0 deletions
File tree
- flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/sink
Lines changed: 48 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
124 | 124 | | |
125 | 125 | | |
126 | 126 | | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
127 | 175 | | |
128 | 176 | | |
129 | 177 | | |
| |||
0 commit comments