Hi Daniel,
You are absolutely right!
I was configuring the compression at topic level, and the broker detected a bigger message that it can handle before compressing, hence the error I shown. I was thinking that if the compressed message fits in the topic, the broker must accept it but that doesn’t seem to be the case.
Setting the compression in the producer of the worker solved the problem. To make this property easier to set only by the topics that need compression, I allowed it to be overriden by the connectors:
Worker config:
connector.client.config.override.policy=All
Connector config:
“producer.override.compression.type”: “gzip”
“topic.creation.default.compression.type”: “producer”
It’s a shame that Mirror Maker is not able to identify source compression on the fly .
Thanks a lot for your help and have a great day!
Brais