Good afternoon.
Currently we are ingesting from logstash ( ELK ) data to kafka and there are some duplicate events of origin that we can not solve therefore, I would like to know if there is any method so that through an id or concatenation of fields the kafka eliminates the duplicates.
Thanks in advance.
Best regards