Kafka to elasticsearch - new index

Is it possible to create a new index based on a particular field in kafka messages?
say my ‘tenant’ field is ‘tenant-1’, a new index called ‘tenant-1-index’ should be created, similarly as ‘tenant-2-index’ if the field has tenant-2 in it. If so, how could this be done?

The Elasticsearch sink connector only makes one index per topic, with a field mapping per entire record schema, rather than at the field-level.

You can instead use Predicate Transforms to define different sinks & indicies per field values.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.