Can I send large messages in Kafka? What do I need to configure if I’m going to? What’s the threshold for needing to make changes?
1 Like
Kafka was not built for large messages. Nevertheless, more and more projects send and process 1Mb, 10Mb, and even much bigger files and other large payloads via Kafka. One reason is that Kafka was designed for large volume/throughput – which is required for large messages. It works well for image processing, video streaming, and sending (or even processing) large CSV or XML files.
Here is a blog post with many details (config, architecture, use cases) about handling large messages in Kafka:
“Handling Large Messages with Apache Kafka (CSV, XML, Image, Video, Audio, Files)”
1 Like
This article is really nice, thank you for sharing.
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.