Confluent Cloud with Glue

I am trying to connect confluent cloud Kafka topic with Glue with and without kafka connector, but it just does not work.
I am able to connect and get messages using same settings on Local pyspark setup.

Can someone point me to any resource which documents this connectivity.

These are the settings with connector:-

  1. Kafka bootstrap server URLs - cluster:9092
  2. Authentication: SASL/SCRAM-SHA-512
    Username and password (API key and secret)
  3. Tested with and without SSL