I’m having an issue in my ksql application where I am losing tombstone records due to my topic-backed stream being queried by tables but streams don’t have tombstone semantics, so they get dropped.
The reason I need to use a stream is because I need to repartition the stream from having a primitive int key:
service_record_id INT KEY,
to having a structured key so my sink connector can consume the record without error:
PARTITION BY STRUCT(service_record_id := service_record_id)
This leaves me with an issue as I can’t both repartition to using a structured key (using only tables stops repartitioning) and keep tombstone records (using a stream will drop any tombstone records). How can I do both of these things in my ksql app?