HTTP Sink Connector not compatible with ndjson

Kafka Connect
1

Im attempting to use the Confluent HTTP Sink connector to push data into OpenSearch. The OpenSearch /_bulk API uses ndjson format http://ndjson.org/. The issue I’m facing is that HTTP Sink connector is trimming all white space which mean I can’t use new line delimited JSON documents. Setting batch.separator to “\n” results in no delimiter, setting to “x \n x” (for example) will preserve the new line character. Is there a known work around for this?

Thanks

2

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.