Debezium deserialization error (EventHeaderV4 EXT_WRITE_ROWS) after long-running MySQL CDC sync #23707

gensmusic · 2025-11-07T02:48:18Z

gensmusic
Nov 7, 2025

Hi RisingWave team,

I'm encountering a recurring Debezium deserialization error when running the MySQL CDC connector in RisingWave. The error appears after many hours of continuous syncing:

io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4{timestamp=1762478510000, eventType=EXT_WRITE_ROWS, serverId=1, headerLength=19, dataLength=8176, nextPosition=986930991, flags=0}
    at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.wrap(MySqlStreamingChangeEventSource.java:1092)
    ...
Caused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{... eventType=EXT_WRITE_ROWS ...}
    ...
Caused by: java.io.EOFException: Failed to read next byte from position 2065193943

Environment

RisingWave version: v2.6.0
MySQL version: 8.0.42 (official Docker image)
Binlog format: ROW
Binlog row image: FULL
Debezium connector: Built-in version from RisingWave
Deployment: Docker-based

Workload and timeline

I’ve run the sync job twice under different ingestion rates:

Run 1:
- MySQL writing rate: ~2000 rows/sec
- Batch size: 1000 rows per insert
- Ran for ~10 hours before error
- RisingWave successfully synced about 68 million rows before the error occurred.
Run 2:
- MySQL writing rate: ~1000 rows/sec
- Batch size: 500 rows per insert
- Ran for ~15 hours before error
- RisingWave synced about 58 million rows before the same deserialization error occurred.

In both cases, the error message was the same (EventHeaderV4 EXT_WRITE_ROWS + EOFException).

Observations

mysqlbinlog --verify-binlog-checksum on the corresponding binlog files shows no corruption.
The deserialization failure always happens after many hours of stable operation, not at startup.

Questions

Could this issue be caused by a version incompatibility between RisingWave v2.6.0’s embedded Debezium and MySQL 8.0.42 (especially around EXT_WRITE_ROWS events)?
Is this a known issue that might be fixed in a newer RisingWave or Debezium release?
Are there configuration options (e.g., Debezium connector settings or internal buffering limits) that can help avoid or recover from this error?

💭 Additional notes

I understand that this type of EOFException may appear when a binlog event is truncated or partially read, but since checksum verification passed and the problem always appears after long continuous ingestion, I suspect it may be related to large transaction handling, binlog event buffering, or Debezium’s MySQL binlog client compatibility.

Any insights or suggestions would be greatly appreciated — thank you!

error logs

2025-11-07T01:27:30.656029962Z ERROR risingwave_connector_node: Error during binlog processing. Last offset stored = {transaction_id=file=binlog.000003,pos=986922646, ts_sec=1762478509, file=binlog.000003, pos=986922646, server_id=1, event=2}, binlog reader near position = binlog.000003/986922728 thread="blc-192.168.81.42:3306" class="io.debezium.connector.mysql.MySqlStreamingChangeEventSource"
2025-11-07T01:27:30.722298587Z ERROR risingwave_connector_node: Producer failure thread="blc-192.168.81.42:3306" class="io.debezium.pipeline.ErrorHandler" error="io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4{timestamp=1762478510000, eventType=EXT_WRITE_ROWS, serverId=1, headerLength=19, dataLength=8176, nextPosition=986930991, flags=0}\n\tat io.debezium.connector.mysql.MySqlStreamingChangeEventSource.wrap(MySqlStreamingChangeEventSource.java:1092)\n\tat io.debezium.connector.mysql.MySqlStreamingChangeEventSource$ReaderThreadLifecycleListener.onCommunicationFailure(MySqlStreamingChangeEventSource.java:1137)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1105)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:655)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:954)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\nCaused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1762478510000, eventType=EXT_WRITE_ROWS, serverId=1, headerLength=19, dataLength=8176, nextPosition=986930991, flags=0}\n\tat com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:343)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246)\n\tat io.debezium.connector.mysql.strategy.AbstractBinaryLogClientConfigurator$1.nextEvent(AbstractBinaryLogClientConfigurator.java:110)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077)\n\t... 3 more\nCaused by: java.io.EOFException: Failed to read next byte from position 2065193943\n\tat com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.read(ByteArrayInputStream.java:226)\n\tat com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.readInteger(ByteArrayInputStream.java:52)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeLong(AbstractRowsEventDataDeserializer.java:235)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeCell(AbstractRowsEventDataDeserializer.java:161)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeRow(AbstractRowsEventDataDeserializer.java:143)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.WriteRowsEventDataDeserializer.deserializeRows(WriteRowsEventDataDeserializer.java:64)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.WriteRowsEventDataDeserializer.deserialize(WriteRowsEventDataDeserializer.java:56)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.WriteRowsEventDataDeserializer.deserialize(WriteRowsEventDataDeserializer.java:32)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:337)\n\t... 6 more\n"
2025-11-07T01:27:30.723263754Z  WARN risingwave_connector_node: Retry 1 of unlimited retries will be attempted thread="blc-192.168.81.42:3306" class="io.debezium.pipeline.ErrorHandler"
2025-11-07T01:27:31.699785088Z ERROR risingwave_connector_node: Exception while closing JDBC connection thread="rw-dbz-engine-runner-6" class="io.debezium.connector.mysql.MySqlConnectorTask" error="java.sql.SQLNonTransientConnectionException: Communications link failure during rollback(). Transaction resolution unknown.\n\tat com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:102)\n\tat com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)\n\tat com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:81)\n\tat com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:55)\n\tat com.mysql.cj.jdbc.ConnectionImpl.rollback(ConnectionImpl.java:1931)\n\tat com.mysql.cj.jdbc.ConnectionImpl.doClose(ConnectionImpl.java:1760)\n\tat com.mysql.cj.jdbc.ConnectionImpl.close(ConnectionImpl.java:718)\n\tat io.debezium.jdbc.JdbcConnection.lambda$doClose$4(JdbcConnection.java:951)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:27:31.709089171Z  INFO risingwave_connector_node: Retriable exception thrown, connector will be restarted; errors.max.retries=-1 thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="org.apache.kafka.connect.errors.RetriableException: An exception occurred in the change event producer. This connector will be restarted.\n\tat io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:63)\n\tat io.debezium.connector.mysql.MySqlStreamingChangeEventSource$ReaderThreadLifecycleListener.onCommunicationFailure(MySqlStreamingChangeEventSource.java:1137)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1105)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:655)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:954)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\nCaused by: io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4{timestamp=1762478510000, eventType=EXT_WRITE_ROWS, serverId=1, headerLength=19, dataLength=8176, nextPosition=986930991, flags=0}\n\tat io.debezium.connector.mysql.MySqlStreamingChangeEventSource.wrap(MySqlStreamingChangeEventSource.java:1092)\n\t... 5 more\nCaused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1762478510000, eventType=EXT_WRITE_ROWS, serverId=1, headerLength=19, dataLength=8176, nextPosition=986930991, flags=0}\n\tat com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:343)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246)\n\tat io.debezium.connector.mysql.strategy.AbstractBinaryLogClientConfigurator$1.nextEvent(AbstractBinaryLogClientConfigurator.java:110)\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077)\n\t... 3 more\nCaused by: java.io.EOFException: Failed to read next byte from position 2065193943\n\tat com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.read(ByteArrayInputStream.java:226)\n\tat com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.readInteger(ByteArrayInputStream.java:52)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeLong(AbstractRowsEventDataDeserializer.java:235)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeCell(AbstractRowsEventDataDeserializer.java:161)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeRow(AbstractRowsEventDataDeserializer.java:143)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.WriteRowsEventDataDeserializer.deserializeRows(WriteRowsEventDataDeserializer.java:64)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.WriteRowsEventDataDeserializer.deserialize(WriteRowsEventDataDeserializer.java:56)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.WriteRowsEventDataDeserializer.deserialize(WriteRowsEventDataDeserializer.java:32)\n\tat com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:337)\n\t... 6 more\n"
2025-11-07T01:27:31.721789129Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:31.721967921Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:31.722077379Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:33.435710922Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:27:33.738538755Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:33.738644005Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:33.738715589Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:33.805728922Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:27:34.418915672Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:34.418966714Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:34.419272172Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:34.509730547Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:27:35.720463798Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:35.720530548Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:35.720716548Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:35.861971548Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:27:38.288695549Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:38.288726841Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:38.288760466Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:38.452396466Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:27:43.255934385Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:43.255958885Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:43.255986552Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:43.385582552Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:27:52.995016542Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:52.995122125Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:52.995187667Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:27:53.027572042Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:28:03.03240763Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:03.032502463Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:03.032533713Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:03.076610713Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:28:13.081136468Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:13.081269135Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:13.081327635Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:13.130149427Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:28:23.132983125Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:23.133048334Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:23.13307025Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:23.180654834Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:28:33.183027172Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:33.183049213Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:33.183068588Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:33.212333505Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:28:43.215914593Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:43.215945052Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:43.215964802Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:43.243029552Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:28:53.246437042Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:53.246503209Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:53.246532792Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:28:53.269703459Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:29:03.274933839Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:03.27499363Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:03.275029797Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:03.310821755Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:29:13.312789093Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:13.312828552Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:13.312840302Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:13.331251427Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:29:23.333514125Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:23.33356125Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:23.333581625Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:23.360970584Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:29:33.366095755Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:33.366150839Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:33.366185672Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:33.395442172Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:29:43.398105218Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:43.398143552Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:43.398161802Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:43.42352726Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:29:53.427483542Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:53.427523417Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:53.427538792Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:29:53.456160167Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:30:03.458908297Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:03.45899238Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:03.459019922Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:03.490062172Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:30:13.494091843Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:13.494189427Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:13.494232552Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:13.521179552Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:30:23.526505084Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:23.526703709Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:23.526829209Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:23.567019917Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-dbz-engine-runner-6" class="io.debezium.embedded.EmbeddedEngine" error="io.debezium.DebeziumException: The db history topic is missing. You may attempt to recover it by reconfiguring the connector to recovery.\n\tat io.debezium.connector.common.BaseSourceTask.validateAndLoadSchemaHistory(BaseSourceTask.java:119)\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:139)\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:248)\n\tat io.debezium.embedded.EmbeddedEngine.handleRetries(EmbeddedEngine.java:671)\n\tat io.debezium.embedded.EmbeddedEngine.pollRecords(EmbeddedEngine.java:709)\n\tat io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:466)\n\tat io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:163)\n\tat com.risingwave.connector.source.core.DbzCdcEngine.run(DbzCdcEngine.java:67)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n"
2025-11-07T01:30:33.571298755Z  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:33.571362547Z  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:33.571391422Z  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-6" class="io.debezium.connector.common.BaseSourceTask"
2025-11-07T01:30:33.599176755Z ERROR risingwave_connector_node: Can't start the connector, will retry later... thread="rw-

zwang28 · 2025-11-10T06:21:27Z

zwang28
Nov 10, 2025
Collaborator

The Failed to deserialize data error might be a transient error. However, based on the log you provided, subsequent retry fails due to The db history topic is missing.

Could you provide the CDC offset stored in RisingWave when the retry failure occurs? Locate the internal table of this CDC source, and query it, e.g.

dev=> show internal tables;
                  Name                   
-----------------------------------------
 public.__internal_pg_s_mysql_1_source_0
(1 row)

dev=> select * from public.__internal_pg_s_mysql_1_source_0;
 partition_id |                                                                                                         offset_info                                                                                                          
--------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 6            | {"split_info": {"citus_split": null, "mongodb_split": null, "mysql_split": {"inner": {"snapshot_done": false, "split_id": 6, "start_offset": null}}, "pg_split": null, "sql_server_split": null}, "split_type": "mysql-cdc"}
(1 row)

Please try running your workload again on RisingWave 2.6.2 when it is released. It includes a fix for a related issue.

0 replies

This comment was marked as off-topic.

Sign in to view

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

RisingWave Labs

Debezium deserialization error (EventHeaderV4 EXT_WRITE_ROWS) after long-running MySQL CDC sync #23707

Uh oh!

{{title}}

Uh oh!

Replies: 2 comments

This comment was marked as off-topic.

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{editor}}'s edit

{{editor}}'s edit

Uh oh!

Select a reply

Uh oh!

RisingWave Labs

Debezium deserialization error (EventHeaderV4 EXT_WRITE_ROWS) after long-running MySQL CDC sync #23707

Uh oh!

gensmusic Nov 7, 2025

Environment

Workload and timeline

Observations

Questions

💭 Additional notes

error logs

Replies: 2 comments

This comment was marked as off-topic.

Uh oh!

Uh oh!

zwang28 Nov 10, 2025 Collaborator

gensmusic
Nov 7, 2025

zwang28
Nov 10, 2025
Collaborator