how do we calculate number of brokers and zookeepers required for a multi-tenant platform. Also number of partitions across brokers, replication factor, in-sync replica. Is there any calculation to do that
Hi Lisha,
did you consider trying
Could be a good point to start with.
Best,
Michael
Thanks Michael. That was helpful.
I am also looking for some guidance on how to design a multi-tenant (shared) platform.
I have 6 brokers , as per the eventsizer Maximum topic partitions: 14,400 (includes replica partitions). Is this the maximum partitions allowed in the broker combining all the partitions?
What if the max partition limit is reached? what will be the behavior.
Is horizontal scaling recommended?
ok cool
it’s recommend to have not more than 4000 partitions per broker nevertheless it’s no
hard limit.
thiss is related to huge partition reassignments in case of a node failure or similar.
cluster wide you could have 200000 partitions see
Hi Michael
Thanks for the clarification.
We want to build an event backbone. We are currently looking to have a kafka cluster with 6 brokers, but eventually we would like to scale up and add more brokers to the clusters. We want this setup to use payments data and hence a critical service.
Do you have any guidance on how to scale up without any data loss. We will be using Community edition.
Thanks
Lisha
Hello Michael,
It seems to me that eventsizer.io is not working properly. As soon as I submit any form I get a network error. I’ve been trying it for days, from multiple devices and networks, and it seems the issue is related to the website. Even the simple Partitions Mode or even Feedback seem to suffer from this. Any idea who to contact to have a look at this?
Kind Regards,
Petru