HTTP Sink Connector not compatible with ndjson

Im attempting to use the Confluent HTTP Sink connector to push data into OpenSearch. The OpenSearch /_bulk API uses ndjson format The issue I’m facing is that HTTP Sink connector is trimming all white space which mean I can’t use new line delimited JSON documents. Setting batch.separator to “\n” results in no delimiter, setting to “x \n x” (for example) will preserve the new line character. Is there a known work around for this?


This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.