Hello,
I’m doing research to better understand KRaft’s expected resource utilization. I ran into a Confluent doc that provides a recommended disk size of at least 64GB, and I’m looking for help understanding what drives the recommendation.
Confluent’s documentation says
Minimum of 4 GB of RAM
An SSD disk at least 64 GB in size is highly recommended
Apache’s KRaft documentation says
The Kafka controllers store all the metadata for the cluster in memory and on disk. We believe that for a typical Kafka cluster 5GB of main memory and 5GB of disk space on the metadata log directory is sufficient.
Confluent’s RAM minimum is similar to the Apache estimate of KRaft’s RAM use, whereas Confluent’s recommended disk minimum is more than 10x Apache’s estimate of KRaft’s metadata log directory disk use.
Could someone explain what drives the 64 GB recommendation? Is it mainly for operational headroom plus a safety buffer on top of the 5 GB of use expected for KRaft metadata, or is there more to the picture?
Thank you,
Morgan