We have different types of messages(SMS,Emails etc.) being sent to consumers from the Kafka Consumer. When I read about the Streams API the use cases are usually related to stream processing. We want to use a scalable API but at this time we are not operating(map/reduce/filter) on the messages and creating topics in the consumer.
But we need DLQs and we can’t anticipate the future changes that may require Streams. And we need to monitor the messages carefully as it is a financial system. We don’t want to lose messages without trace or send duplicates.
Should I look at the Streams API(Spring Boot) more closely for our use cases ? What specific technical features apply to our type of systems ?
Events are coming into our system through Kafka Connect.