canal解析消息推送kafka报错

[bruse-peng]

Question

我们canal instance报错日志如下：想问下，如果我们数据表定义的是text类型，数据就很大，而kafka限制topic推送消息大小有限制，canal有办法解决吗？比如把消息分段推送
2025-10-13 09:59:09.375 [pool-5-thread-6] ERROR com.alibaba.otter.canal.kafka.CanalKafkaProducer - java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.RecordTooLargeException: The message is
19103068 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.RecordTooLargeException: The message is 19103068 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.
at com.alibaba.otter.canal.kafka.CanalKafkaProducer.produce(CanalKafkaProducer.java:215) ~[canal.deployer-1.1.4-jar-with-dependencies.jar:na]| at com.alibaba.otter.canal.kafka.CanalKafkaProducer.send(CanalKafkaProducer.java:179) ~[canal.deployer-1.1.4-jar-with-dependencies.jar:na] at com.alibaba.otter.canal.kafka.CanalKafkaProducer.send(CanalKafkaProducer.java:120) ~[canal.deployer-1.1.4-jar-with-dependencies.jar:na] at com.alibaba.otter.canal.server.CanalMQStarter.worker(CanaIMQStarter.java:183) [canal.deployer-1.1.4-jar-with-dependencies.jar:na] at com.alibaba.otter.canal.server.CanalMQStarter.access$500(CanalMQStarter.java:23) [canal.deployer-1.1.4-jar-with-dependencies.jarna] at com.alibaba.otter.canal.server.CanalMQStarter$CanalMQRunnable.run(CanalMQStarter.java:225) [canal.deployer-1.1.4-jar-with-dependencies.jar:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo|Executor.java:1149) [na:1.8.0_232]
QStarterjava:225) [canal. deployer-1.14-jar-with-dependencies.