Commit 0e53f9e
committed
fix: align kafka consumer fetch ceiling to 64 MiB broker max
librdkafka defaults max.partition.fetch.bytes to 1 MiB and fetch.max.bytes
to 50 MiB, both below the 64 MiB a DLQ re-publish can reach. An
oversized-but-valid record is accepted/stored by the broker yet trips
MSG_SIZE_TOO_LARGE on consume, wedging the partition in a re-seek loop
(observed: DLQ replay group at ~243 MiB in-flight, 0 committed partitions).
Raise consumer fetch ceilings to match the producer/broker 64 MiB
max.message.bytes. Config-only; applies to both primary and _dlq groups.1 parent 0b45863 commit 0e53f9e
1 file changed
Lines changed: 8 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
470 | 470 | | |
471 | 471 | | |
472 | 472 | | |
| 473 | + | |
| 474 | + | |
| 475 | + | |
| 476 | + | |
| 477 | + | |
| 478 | + | |
| 479 | + | |
| 480 | + | |
473 | 481 | | |
474 | 482 | | |
475 | 483 | | |
| |||
0 commit comments