Tiered Storage question on setup - Confluent Platform

Ops
1

I’m trying to setup tiered storage as a test on my local box (ubuntu) with all-in-one Confluent Platform (tar.gz). I’ve tested S3 sink connector and it’s working just fine, but I keep getting the following error when tiered storage is enabled:

[2020-12-26 19:55:53,595] WARN Failed to become ready. Retrying in 5000ms. (kafka.tier.topic.TierTopicManager)
[2020-12-26 19:55:58,600] WARN Caught exception when ensuring tier topic is created. Will retry. (kafka.tier.topic.TierTopicManager)
org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 1.

I’ve followed the documentation (Tiered Storage | Confluent Documentation), which looks pretty straight forward. I also checked all the config files, by default replication factor is set to 1 anyways. I have the datagen connector populating pageviews topic but I keep getting the above error and nothing gets sent to S3 bucket. I can’t find any online resources about this since it’s pretty new I guess.

I’d appreciate it if anyone has faced this issue before or can show me some pointers.
Thanks in advance.

2

If you haven’t already done so, perhaps try configuring the following broker property:

confluent.tier.metadata.replication.factor=1
3

hey selim,
how did you create the topic?
with
--replication-factor 3
or
--replication-factor 1

4

Just tried that and it’s working. Thank you.

confluent.tier.metadata.replication.factor=1

5

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.