I have 3 topics , each topic contains some metric data I’m getting from a CDC connector from SQL. Each topic has an ID column.
On the elastic connector, I select the 3 topics and send to a single index name using the Transform regex,
topicRegexrouter : SQL_.* > MyNewIndex
The issue now I suspect is on my ID being the offset, Im not getting all the data as 1 could have 3 rows with the same id , and thinks its already consumed this as using this as the offset.
Looking for options on working round this.