Do we need to load complete data from OLD Data base to create streams

Confluent Cloud
1

Hi ,

If we want to start using streams and ksql DB for our customer data do we need to load all our current master database to ksql db upfront and start applying streams ?

Thanks
phani

2

It depends entirely on whether you want to process that previous data, or just new data that subsequently arrives.

You can use Kafka Connect to ingest data from a database into Kafka if you do want to back-populate it.

1 Like