My Kafka Streams application is not processing any data from the input topic or kind of data flow is stuck when there is a connection issue with one of the brokers, the application is keep throwing the connection error, though it is a warning message the data is not getting processed, the data flow is stuck and the log is full of this message.
My question is why the data flow is stuck, it can try to connect to another broker if there is a connection issue with one of the brokers in the bootstrap.server list. The application was running fine and when this occurred the data movement is stuck and had to restart the particular broker in error to get the data flowing through.
[kafka-admin-client-thread | dedupe-group-feed-id001-admin] WARN org.apache.kafka.clients.NetworkClient - [AdminClient clientId=dedupe-group-feed-id001-admin] Connection to node 7 (lx12345.msncore.net/11.12.34.456:9094) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue.