I am trying to direct stream (KafkaUtils.createDirectStream) messages from a spark 2.4.8 cluster connecting to a Kafka Broker on confluent 5.5.2. I keep getting this exception
java.lang.NoSuchMethodError: scala.Product.$init$(Lscala/Product;)V
It fails in this line that is call LocationStrategies.PreferConsistent() which is imported as
import org.apache.spark.streaming.kafka010.ConsumerStrategies;