I am trying to connect confluent cloud Kafka topic with Glue with and without kafka connector, but it just does not work.
I am able to connect and get messages using same settings on Local pyspark setup.
Can someone point me to any resource which documents this connectivity.
These are the settings with connector:-
- Kafka bootstrap server URLs - cluster:9092
- Authentication: SASL/SCRAM-SHA-512
Username and password (API key and secret) - Tested with and without SSL