Kafka transactions

[JohnColeman-CTO]

Are transactions fully implemented?

I do not see anything in the code indicating that the feature is supported. This means that you cannot guarantee one time delivery in a consumer-producer pipeline.

[natansil]

Hi @JohnColeman-CTO,

Currently Greyhound does not have support for exactly-once-processing (i.e. Kafka transactions).
But we plan to introduce it in 2021.

The idea is to have an additional ExactlyOnceProcessor (which will encapsulate both a consumer and producer) alongside RecordConsumer (which provides at least once guarantees)

CC: @berman7