I’m trying to setup kafka-connect, using S3Sink, which reads from kafka writes msgs to S3.
Getting below error, the moment kafka-connect comes up. Please help.
[2022-05-16 10:58:38,043] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
hi @Pramodniralakeri
could you share your config?
best,
michael
Here is my all config
CONNECT_GROUP_ID=kafka-connect
LANG=C.UTF-8
HOSTNAME=f0a2404a8628
CONNECT_STATUS_STORAGE_REPLICATION_FACTOR=1
CONNECT_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
CONNECT_CONFIG_STORAGE_TOPIC=__connect-config
CONNECT_LOG4J_LOGGERS=org.apache.zookeeper=ERROR,org.I0Itec.zkclient=ERROR,org.reflections=ERROR
CONNECT_REST_LISTENERS=http://localhost:8083
NODE_ENV=production
container=oci
CONNECT_OFFSET_STORAGE_REPLICATION_FACTOR=1
CONNECT_PLUGIN_PATH="/usr/share/java,/usr/share/confluent-hub-components/,/connectors/"
CONNECT_OFFSET_STORAGE_TOPIC=__connect-offsets
APP_ENV=production
PWD=/home/appuser
HOME=/home/appuser
CONNECT_BOOTSTRAP_SERVERS=broker-1.snowplow.kafka.production.saltside.net:9092,broker-2.snowplow.kafka.production.saltside.net:9092,broker-3.snowplow.kafka.production.saltside.net:9092
CONNECT_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
CONNECT_KEY_CONVERTER_SCHEMA_REGISTRY_URL=tcp://snowplow-stream-schema-registry:8081
KAFKA_ADVERTISED_LISTENERS=
CONTEXT=prod-sg
AWS_REGION=ap-southeast-1
CONNECT_REST_ADVERTISED_HOST_NAME=kafka-s3-sink
CONNECT_OFFSET_FLUSH_INTERVAL_MS=10000
CONNECT_INTERNAL_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
CONNECT_REST_PORT=8083
COMPONENT=kafka-connect
TERM=xterm
RACK_ENV=production
CONNECT_STATUS_STORAGE_TOPIC=__connect-status
CONNECT_INTERNAL_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL=tcp://snowplow-stream-schema-registry:8081
SHLVL=1
KAFKA_ZOOKEEPER_CONNECT=
PATH=/home/appuser/.local/bin:/home/appuser/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
CUB_CLASSPATH="/usr/share/java/cp-base-new/*"
CONNECT_CONFIG_STORAGE_REPLICATION_FACTOR=1
_=/usr/bin/env
Container die after 1 or 2 min. it comes up. with the logs.
[2022-05-16 10:58:38,043] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
AND
[2022-05-18 05:16:10,401] INFO [Worker clientId=connect-1, groupId=kafka-connect] Finished reading to end of log and updated config snapshot, new config log offset: 3305 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,401] INFO [Worker clientId=connect-1, groupId=kafka-connect] Failed to write new session key to config topic; forcing a read to the end of the config topic before possibly retrying (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,401] INFO [Worker clientId=connect-1, groupId=kafka-connect] Reading to end of config log; current config state offset: 3305 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,403] INFO [Worker clientId=connect-1, groupId=kafka-connect] Finished reading to end of log and updated config snapshot, new config log offset: 3305 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,403] INFO [Worker clientId=connect-1, groupId=kafka-connect] Failed to write new session key to config topic; forcing a read to the end of the config topic before possibly retrying (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,403] INFO [Worker clientId=connect-1, groupId=kafka-connect] Reading to end of config log; current config state offset: 3305 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
thx the s3 sink connector jar is available in your plugin dir?
Yes it’s available at
/usr/share/confluent-hub-components/confluentinc-kafka-connect-s3
following folder structure
drwxr-xr-x 2 appuser appuser 4096 May 16 06:14 assets
drwxr-xr-x 4 appuser appuser 4096 May 16 06:14 doc
drwxr-xr-x 2 appuser appuser 4096 May 16 06:14 etc
drwxr-xr-x 2 appuser appuser 4096 May 16 06:14 lib
-rw-r--r-- 1 appuser appuser 2226 May 16 06:14 manifest.json
I’m trying to run individual kafka cluster( 2.12-2.2.0 version broker), and using kafka-connect separately with S3Connector but run into above issue.
confluentinc/cp-kafka-connect-base:6.2.4
confluentinc/kafka-connect-s3:10.0.7
maybe one step back
how did you start you env?
with docker/docker-compose?
Docker
FROM confluentinc/cp-kafka-connect-base:6.2.4
RUN confluent-hub install --no-prompt confluentinc/kafka-connect-s3:10.0.7
RUN confluent-hub install --no-prompt neo4j/kafka-connect-neo4j:1.0.0
ENV CONNECT_PLUGIN_PATH='/usr/share/java,/usr/share/confluent-hub-components/,/connectors/'
ENV CONNECT_BOOTSTRAP_SERVERS=${DATA_SNOWPLOW_KAFKA_BROKER_LIST}
ENV CONNECT_REST_ADVERTISED_HOST_NAME="kafka-connect"
ENV CONNECT_REST_PORT=8083
ENV CONNECT_REST_LISTENERS="http://localhost:8083"
ENV CONNECT_GROUP_ID=kafka-connect
ENV CONNECT_CONFIG_STORAGE_TOPIC=__connect-config
ENV CONNECT_OFFSET_STORAGE_TOPIC=__connect-offsets
ENV CONNECT_STATUS_STORAGE_TOPIC=__connect-status
ENV CONNECT_INTERNAL_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_INTERNAL_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_LOG4J_LOGGERS="org.apache.kafka.connect.runtime.rest=WARN,org.reflections=ERROR"
ENV CONNECT_CONFIG_STORAGE_REPLICATION_FACTOR="1"
ENV CONNECT_OFFSET_STORAGE_REPLICATION_FACTOR="1"
ENV CONNECT_STATUS_STORAGE_REPLICATION_FACTOR="1"
.
.
.
and then
/etc/confluent/docker/run & sleep infinity
command while starting the container
And some of ENV are set by platform-team, which are common across all applications. using puppet files or so. Kind of ENVs default available to application
You need to start fresh (delete the three connect topics)
These values should not be changed from JSONConverter. In fact, they are deprecated properties, and you should simply remove them from the Compose file / environment variables.
This is evident by class [B in your error, which means the Connect topic data was stored as a ByteArray rather than as JSON.
I see new error now java.lang.ClassNotFoundException
[2022-05-20 16:54:55,031] WARN could not get type for name org.jdom.output.XMLOutputter from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.jdom.output.XMLOutputter
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
at org.reflections.Reflections.<init>(Reflections.java:140)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.jdom.output.XMLOutputter
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
... 11 more
And
at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
at org.reflections.Reflections.<init>(Reflections.java:140)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: javax.servlet.jsp.JspException
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
... 11 more
[2022-05-20 16:54:55,055] WARN could not get type for name org.jaxen.dom.DocumentNavigator from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.jaxen.dom.DocumentNavigator
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
at org.reflections.Reflections.<init>(Reflections.java:140)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.jaxen.dom.DocumentNavigator
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
... 11 more
So on…
Kafka Connect doesn’t need XML-related classes (jdom), AFAIK, so that seems like a completely different problem.
it’s not just XML related, it’s throwing exception for every possible class.
like javax.servlet.jsp.JspException and org.jaxen.dom.DocumentNavigator and many more.
Not sure what I’m missing
org.jaxen is also XML related, from what I can tell. And Connect doesn’t use JSP Servlets, either.
I know the S3 will return XML error responses in certain conditions, but unless you have an active S3 connector deployed, that shouldn’t matter for the initial error that was posted regarding the Connect storage topic.
You did delete the topics and create brand new ones, yes? I was able to start my own Connect server just fine with the settings you’ve shown so far.
Interesting, just pasting few errors just in case if you could find any clue. (please see error logs till end, as all of it are different one another)
[2022-05-21 04:28:34,741] WARN could not get type for name org.conscrypt.HandshakeListener from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.conscrypt.HandshakeListener
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
at org.reflections.Reflections.<init>(Reflections.java:140)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.conscrypt.HandshakeListener
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
[2022-05-21 04:28:34,742] WARN could not get type for name org.python.util.PythonInterpreter from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.python.util.PythonInterpreter
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
at org.reflections.Reflections.<init>(Reflections.java:140)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.python.util.PythonInterpreter
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
... 11 more
[2022-05-21 04:28:34,755] DEBUG expanded subtype java.io.Closeable -> java.io.InputStream (org.reflections.Reflections)
[2022-05-21 04:28:34,756] DEBUG expanded subtype java.lang.AutoCloseable -> java.io.Closeable (org.reflections.Reflections)
[2022-05-21 04:28:34,757] WARN could not get type for name org.jboss.marshalling.ByteInput from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.jboss.marshalling.ByteInput
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
at org.reflections.Reflections.<init>(Reflections.java:140)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.jboss.marshalling.ByteInput
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
... 11 more
[2022-05-21 04:28:34,768] WARN could not get type for name javax.servlet.jsp.JspWriter from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name javax.servlet.jsp.JspWriter
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
at org.reflections.Reflections.<init>(Reflections.java:140)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: javax.servlet.jsp.JspWriter
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
... 11 more
[2022-05-21 04:28:34,769] DEBUG expanded subtype java.lang.ref.Reference -> java.lang.ref.SoftReference (org.reflections.Reflections)
[2022-05-21 04:28:34,770] DEBUG expanded subtype java.nio.channels.ReadableByteChannel -> java.nio.channels.ScatteringByteChannel (org.reflections.Reflections)
[2022-05-21 04:28:34,770] DEBUG expanded subtype java.nio.channels.Channel -> java.nio.channels.ReadableByteChannel (org.reflections.Reflections)
[2022-05-21 04:28:34,770] DEBUG expanded subtype java.io.Closeable -> java.nio.channels.Channel (org.reflections.Reflections)
[2022-05-21 04:28:34,770] DEBUG expanded subtype java.lang.AutoCloseable -> java.io.Closeable (org.reflections.Reflections)
[2022-05-21 04:28:34,775] DEBUG expanded subtype java.nio.channels.Channel -> java.nio.channels.WritableByteChannel (org.reflections.Reflections)
[2022-05-21 04:28:34,775] DEBUG expanded subtype java.io.Closeable -> java.nio.channels.Channel (org.reflections.Reflections)
[2022-05-21 04:28:34,775] DEBUG expanded subtype java.lang.AutoCloseable -> java.io.Closeable (org.reflections.Reflections)
[2022-05-21 04:28:34,779] DEBUG expanded subtype com.fasterxml.jackson.databind.deser.NullValueProvider -> com.fasterxml.jackson.databind.JsonDeserializer (org.reflections.Reflections)
[2022-05-21 04:28:34,789] DEBUG expanded subtype java.lang.Iterable -> java.util.Collection (org.reflections.Reflections)
[2022-05-21 04:28:34,792] DEBUG expanded subtype java.util.Collection -> java.util.Queue (org.reflections.Reflections)
[2022-05-21 04:28:34,792] DEBUG expanded subtype java.lang.Iterable -> java.util.Collection (org.reflections.Reflections)
[2022-05-21 04:28:34,794] DEBUG expanded subtype java.util.concurrent.ExecutorService -> java.util.concurrent.AbstractExecutorService (org.reflections.Reflections)
[2022-05-21 04:28:34,795] DEBUG expanded subtype java.util.concurrent.Executor -> java.util.concurrent.ExecutorService (org.reflections.Reflections)
[2022-05-21 04:28:34,798] WARN could not get type for name javax.servlet.jsp.el.VariableResolver from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name javax.servlet.jsp.el.VariableResolver
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
at org.reflections.Reflections.<init>(Reflections.java:140)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: javax.servlet.jsp.el.VariableResolver
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
... 11 more
[2022-05-21 04:28:40,574] DEBUG [Thread[org.reflections-scanner-2,5,main]] scanning file:/usr/share/java/kafka/netty-transport-4.1.73.Final.jar (org.reflections.Reflections)
[2022-05-21 04:28:40,592] DEBUG [Thread[org.reflections-scanner-1,5,main]] scanning file:/etc/kafka-connect/jars/* (org.reflections.Reflections)
[2022-05-21 04:28:40,593] WARN could not create Vfs.Dir from url. ignoring the exception and continuing (org.reflections.Reflections)
org.reflections.ReflectionsException: could not create Vfs.Dir from url, no matching UrlType was found [file:/etc/kafka-connect/jars/*]
either use fromURL(final URL url, final List<UrlType> urlTypes) or use the static setDefaultURLTypes(final List<UrlType> urlTypes) or addDefaultURLTypes(UrlType urlType) with your specialized UrlType.
at org.reflections.vfs.Vfs.fromURL(Vfs.java:114)
at org.reflections.vfs.Vfs.fromURL(Vfs.java:96)
at org.reflections.Reflections.scan(Reflections.java:257)
at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.scan(DelegatingClassLoader.java:449)
at org.reflections.Reflections.lambda$scan$0(Reflections.java:213)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
[2022-05-21 04:28:42,823] ERROR Stopping due to error (org.apache.kafka.connect.cli.ConnectDistributed)
org.apache.kafka.common.config.ConfigException: Invalid value "1" for configuration offset.storage.replication.factor: Not a number of type SHORT
at org.apache.kafka.common.config.ConfigDef.parseType(ConfigDef.java:742)
at org.apache.kafka.common.config.ConfigDef.parseValue(ConfigDef.java:490)
at org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:483)
at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:108)
at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:129)
at org.apache.kafka.connect.runtime.WorkerConfig.<init>(WorkerConfig.java:452)
at org.apache.kafka.connect.runtime.distributed.DistributedConfig.<init>(DistributedConfig.java:405)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:95)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
This is the reason it won’t start, so focus on one error at a time
ConfigException: Invalid value "1" for configuration offset.storage.replication.factor: Not a number of type SHORT