Kafka's throughput

Kafka Streams
1

Hi!

What I’m wondering is how long it would take Kafka on Confluent platform to upload tens of millions of posts to topics. Can you give a rough estimate?

Any help would be very appreciated.

2

Hi @BrunoHensher

it’s quite hard (to impossible) to provide an estimate
as it depends on several factors like
disk throughput, partition design, replication factor and so on

some links which may help:

https://docs.confluent.io/platform/current/kafka/sbc/performance.html#test-scalability-of-a-large-cluster-with-many-partitions

hth,
michael

1 Like
3

Thanks. Michael!
I will read it.