Not able to consume any messages in a kafka cluster of three brokers if we map wrong ip address of one of the broker server in host file.

[nitinkumar758]

Description

We have a kafka cluster of three brokers and we are not able to consume a single messages if we change IP address of one of the broker in windows host file while the other two broker's ip address remain same.

How to reproduce

We have a kafka cluster of three brokers, we have set up a windows machine where we are running one producer which produce 30,000 messages for test topic having 24 partition and in same machine we have three consumer consuming for same test topic .

Now in host file (location C:\Windows\System32\drivers\etc\hosts) we have mapped the kafka1 server with wrong ip address and other two server with correct ip address then save it after that we have started all three consumers and then start producing messages on test topic .

Expected Result- producer will produce messages and consumer will consume messages from other two kafka server except kafka 1 server

Actual Result - producer is producing messages however consumers are not able to consumer even a single messages.

Below is the consumer config properties-

Below is the producer config properties-

Below is the one of the consumer's log-

2019-04-22 23:39:51,601 [1] INFO - Enterd In CodeSignConsumer
2019-04-22 23:39:51,648 [1] INFO - Poll Interval 200
2019-04-22 23:39:52,054 [1] INFO - Polling inprogress for every 200
2019-04-22 23:39:53,726 [1] ERROR - Error Ocuured in ConsumerIsLocalErrorTrueIsBrokerErrorFalseReasonkafka1:9092/1: Connect to ipv4#XXXXX:9092 failed: No connection could be made because the target machine actively refused it... (after 2011ms in state CONNECT)
2019-04-22 23:40:16,429 [1] INFO - Polling inprogress for every 200
2019-04-22 23:40:40,804 [1] INFO - Polling inprogress for every 200
2019-04-22 23:41:05,179 [1] INFO - Polling inprogress for every 200
2019-04-22 23:41:29,554 [1] INFO - Polling inprogress for every 200
2019-04-22 23:41:53,929 [1] INFO - Polling inprogress for every 200
2019-04-22 23:42:18,304 [1] INFO - Polling inprogress for every 200

Note: - Some time consumers are also crashes if we again correctly map the kafka server ip in host file and save.

Checklist

• Confluent.Kafka nuget version. - 0.11.6.0
• Apache Kafka version.- 2.10
• Operating system. - windows
• Critical issue.

[nitinkumar758]

Any clue regarding this issue or let me know in case of any concern.

[mhowlett]

can you test to see whether this is a problem in 1.0? If you see the issue there too, I'll try to replicate. 1.0 is a very large update, and contains many bug fixes. Generally, we don't backport fixes to older versions (except in some cases for customers).

[nitinkumar758]

OK will check and update

[nitinkumar758]

Still we are facing the same issue in latest update.. please help.

[mhowlett]

Please provide debug logs (set consumer `Debug` property to `all`) whilst the error is occurring whilst using the latest version (1.2-RC1), and i'll have a look.

…

On Thu, Aug 22, 2019 at 4:08 AM nitinkumar758 ***@***.***> wrote: Still we are facing the same issue in latest update.. please help. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#898?email_source=notifications&email_token=AAAEVZV2ZQU7IFRTS6VPB6TQFZXTJA5CNFSM4HHRSE72YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD44XKEI#issuecomment-523859217>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAAEVZW4RJHOTVIDDLGECWLQFZXTJANCNFSM4HHRSE7Q> .