RocksDB Connector - Source

Kafka Connect
#1

Hi all

Scanning through the list of connectors I could not find… am I being blind, or is there no source connector for RocksDB.

G

#2

To my knowledge, there is not one, no, so you’ll need to write your own.

Can you explain the use case?

Rocksdb is typically built from a compacted Kafka topic, rather than the other way around.

I can imagine the reason that there isn’t such a connector is because it would require the Rocksdb instance to be local to the connector task, and could not be used with distributed mode very easily

#3

I have a ISV application that utilises RocksDB as a data store, want to use a connector to extract the data without touching the application.

G

#4

Alright, well, there are several blog posts on writing your own connector

For example, this one uses a Source Connector

#5

will store the reference, not my wheelhouse, might need one of the developers to look into this if we proceed down the path.

thanks.

G

#6

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.