We have a one producer who sends the millions of messages at one time. The issue we are facing is, kafka is able to handle this volumes and sending it to consumer at the same speed but our consumer application is not able to process same speed and messages are getting piled up at the consumer application side.
To address this issue, we would like to limit the messages speed for this particular producing topic or consumer topic. is this possible? if yes, what configuration changes we need to apply to limit the messages in producer/consumer topics?
looking forward to hearing the solution from community.