ERROR Invalid connector status type class and ERROR Invalid task status type class

Pramodniralakeri · 16 May 2022 13:37

I’m trying to setup kafka-connect, using S3Sink, which reads from kafka writes msgs to S3.
Getting below error, the moment kafka-connect comes up. Please help.

[2022-05-16 10:58:38,043] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)

mmuehlbeyer · 18 May 2022 07:51

hi @Pramodniralakeri

could you share your config?

best,
michael

Pramodniralakeri · 18 May 2022 08:56

Here is my all config

CONNECT_GROUP_ID=kafka-connect
LANG=C.UTF-8
HOSTNAME=f0a2404a8628
CONNECT_STATUS_STORAGE_REPLICATION_FACTOR=1
CONNECT_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
CONNECT_CONFIG_STORAGE_TOPIC=__connect-config
CONNECT_LOG4J_LOGGERS=org.apache.zookeeper=ERROR,org.I0Itec.zkclient=ERROR,org.reflections=ERROR
CONNECT_REST_LISTENERS=http://localhost:8083
NODE_ENV=production
container=oci
CONNECT_OFFSET_STORAGE_REPLICATION_FACTOR=1
CONNECT_PLUGIN_PATH="/usr/share/java,/usr/share/confluent-hub-components/,/connectors/"
CONNECT_OFFSET_STORAGE_TOPIC=__connect-offsets
APP_ENV=production
PWD=/home/appuser
HOME=/home/appuser
CONNECT_BOOTSTRAP_SERVERS=broker-1.snowplow.kafka.production.saltside.net:9092,broker-2.snowplow.kafka.production.saltside.net:9092,broker-3.snowplow.kafka.production.saltside.net:9092
CONNECT_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
CONNECT_KEY_CONVERTER_SCHEMA_REGISTRY_URL=tcp://snowplow-stream-schema-registry:8081
KAFKA_ADVERTISED_LISTENERS=
CONTEXT=prod-sg
AWS_REGION=ap-southeast-1
CONNECT_REST_ADVERTISED_HOST_NAME=kafka-s3-sink
CONNECT_OFFSET_FLUSH_INTERVAL_MS=10000
CONNECT_INTERNAL_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
CONNECT_REST_PORT=8083
COMPONENT=kafka-connect
TERM=xterm
RACK_ENV=production
CONNECT_STATUS_STORAGE_TOPIC=__connect-status
CONNECT_INTERNAL_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
CONNECT_VALUE_CONVERTER_SCHEMA_REGISTRY_URL=tcp://snowplow-stream-schema-registry:8081
SHLVL=1
KAFKA_ZOOKEEPER_CONNECT=
PATH=/home/appuser/.local/bin:/home/appuser/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
CUB_CLASSPATH="/usr/share/java/cp-base-new/*"
CONNECT_CONFIG_STORAGE_REPLICATION_FACTOR=1
_=/usr/bin/env

Container die after 1 or 2 min. it comes up. with the logs.

[2022-05-16 10:58:38,043] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,044] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid task status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] WARN Failed to parse task status with key status-task-s3-kafka-sink-0 (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)
[2022-05-16 10:58:38,045] ERROR Invalid connector status type class [B (org.apache.kafka.connect.storage.KafkaStatusBackingStore)

AND 

[2022-05-18 05:16:10,401] INFO [Worker clientId=connect-1, groupId=kafka-connect] Finished reading to end of log and updated config snapshot, new config log offset: 3305 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,401] INFO [Worker clientId=connect-1, groupId=kafka-connect] Failed to write new session key to config topic; forcing a read to the end of the config topic before possibly retrying (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,401] INFO [Worker clientId=connect-1, groupId=kafka-connect] Reading to end of config log; current config state offset: 3305 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,403] INFO [Worker clientId=connect-1, groupId=kafka-connect] Finished reading to end of log and updated config snapshot, new config log offset: 3305 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,403] INFO [Worker clientId=connect-1, groupId=kafka-connect] Failed to write new session key to config topic; forcing a read to the end of the config topic before possibly retrying (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
[2022-05-18 05:16:10,403] INFO [Worker clientId=connect-1, groupId=kafka-connect] Reading to end of config log; current config state offset: 3305 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)

mmuehlbeyer · 18 May 2022 12:36

thx the s3 sink connector jar is available in your plugin dir?

Pramodniralakeri · 18 May 2022 16:53

Yes it’s available at
/usr/share/confluent-hub-components/confluentinc-kafka-connect-s3

following folder structure

drwxr-xr-x 2 appuser appuser 4096 May 16 06:14 assets
drwxr-xr-x 4 appuser appuser 4096 May 16 06:14 doc
drwxr-xr-x 2 appuser appuser 4096 May 16 06:14 etc
drwxr-xr-x 2 appuser appuser 4096 May 16 06:14 lib
-rw-r--r-- 1 appuser appuser 2226 May 16 06:14 manifest.json

Pramodniralakeri · 19 May 2022 02:11

I’m trying to run individual kafka cluster( 2.12-2.2.0 version broker), and using kafka-connect separately with S3Connector but run into above issue.

confluentinc/cp-kafka-connect-base:6.2.4
confluentinc/kafka-connect-s3:10.0.7

mmuehlbeyer · 19 May 2022 05:34

maybe one step back
how did you start you env?

with docker/docker-compose?

Pramodniralakeri · 19 May 2022 06:39

Docker

FROM confluentinc/cp-kafka-connect-base:6.2.4
RUN confluent-hub install --no-prompt confluentinc/kafka-connect-s3:10.0.7
RUN confluent-hub install --no-prompt neo4j/kafka-connect-neo4j:1.0.0

ENV CONNECT_PLUGIN_PATH='/usr/share/java,/usr/share/confluent-hub-components/,/connectors/'
ENV CONNECT_BOOTSTRAP_SERVERS=${DATA_SNOWPLOW_KAFKA_BROKER_LIST}
ENV CONNECT_REST_ADVERTISED_HOST_NAME="kafka-connect"
ENV CONNECT_REST_PORT=8083
ENV CONNECT_REST_LISTENERS="http://localhost:8083"
ENV CONNECT_GROUP_ID=kafka-connect
ENV CONNECT_CONFIG_STORAGE_TOPIC=__connect-config
ENV CONNECT_OFFSET_STORAGE_TOPIC=__connect-offsets
ENV CONNECT_STATUS_STORAGE_TOPIC=__connect-status
ENV CONNECT_INTERNAL_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_INTERNAL_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_LOG4J_LOGGERS="org.apache.kafka.connect.runtime.rest=WARN,org.reflections=ERROR"
ENV CONNECT_CONFIG_STORAGE_REPLICATION_FACTOR="1"
ENV CONNECT_OFFSET_STORAGE_REPLICATION_FACTOR="1"
ENV CONNECT_STATUS_STORAGE_REPLICATION_FACTOR="1"

.
.
.

and then

/etc/confluent/docker/run & sleep infinity

command while starting the container

And some of ENV are set by platform-team, which are common across all applications. using puppet files or so. Kind of ENVs default available to application

OneCricketeer · 19 May 2022 16:36

You need to start fresh (delete the three connect topics)

These values should not be changed from JSONConverter. In fact, they are deprecated properties, and you should simply remove them from the Compose file / environment variables.

Pramodniralakeri:

ENV CONNECT_INTERNAL_KEY_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter
ENV CONNECT_INTERNAL_VALUE_CONVERTER=org.apache.kafka.connect.converters.ByteArrayConverter

This is evident by class [B in your error, which means the Connect topic data was stored as a ByteArray rather than as JSON.

Pramodniralakeri · 20 May 2022 17:14

I see new error now java.lang.ClassNotFoundException

[2022-05-20 16:54:55,031] WARN could not get type for name org.jdom.output.XMLOutputter from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.jdom.output.XMLOutputter
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
        at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
        at org.reflections.Reflections.<init>(Reflections.java:140)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
        at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.jdom.output.XMLOutputter
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
        ... 11 more

And

        at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
        at org.reflections.Reflections.<init>(Reflections.java:140)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
        at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: javax.servlet.jsp.JspException
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
        ... 11 more
[2022-05-20 16:54:55,055] WARN could not get type for name org.jaxen.dom.DocumentNavigator from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.jaxen.dom.DocumentNavigator
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
        at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
        at org.reflections.Reflections.<init>(Reflections.java:140)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
        at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.jaxen.dom.DocumentNavigator
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
        ... 11 more

So on…

OneCricketeer · 20 May 2022 17:35

Kafka Connect doesn’t need XML-related classes (jdom), AFAIK, so that seems like a completely different problem.

Pramodniralakeri · 21 May 2022 03:36

it’s not just XML related, it’s throwing exception for every possible class.
like javax.servlet.jsp.JspException and org.jaxen.dom.DocumentNavigator and many more.

Not sure what I’m missing

OneCricketeer · 21 May 2022 03:50

org.jaxen is also XML related, from what I can tell. And Connect doesn’t use JSP Servlets, either.

I know the S3 will return XML error responses in certain conditions, but unless you have an active S3 connector deployed, that shouldn’t matter for the initial error that was posted regarding the Connect storage topic.

You did delete the topics and create brand new ones, yes? I was able to start my own Connect server just fine with the settings you’ve shown so far.

Pramodniralakeri · 21 May 2022 04:41

Interesting, just pasting few errors just in case if you could find any clue. (please see error logs till end, as all of it are different one another)

[2022-05-21 04:28:34,741] WARN could not get type for name org.conscrypt.HandshakeListener from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.conscrypt.HandshakeListener
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
        at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
        at org.reflections.Reflections.<init>(Reflections.java:140)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
        at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.conscrypt.HandshakeListener
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)






[2022-05-21 04:28:34,742] WARN could not get type for name org.python.util.PythonInterpreter from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.python.util.PythonInterpreter
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
        at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
        at org.reflections.Reflections.<init>(Reflections.java:140)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
        at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.python.util.PythonInterpreter
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
        ... 11 more


[2022-05-21 04:28:34,755] DEBUG expanded subtype java.io.Closeable -> java.io.InputStream (org.reflections.Reflections)
[2022-05-21 04:28:34,756] DEBUG expanded subtype java.lang.AutoCloseable -> java.io.Closeable (org.reflections.Reflections)
[2022-05-21 04:28:34,757] WARN could not get type for name org.jboss.marshalling.ByteInput from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name org.jboss.marshalling.ByteInput
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
        at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
        at org.reflections.Reflections.<init>(Reflections.java:140)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
        at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: org.jboss.marshalling.ByteInput
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
        ... 11 more


[2022-05-21 04:28:34,768] WARN could not get type for name javax.servlet.jsp.JspWriter from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name javax.servlet.jsp.JspWriter
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
        at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
        at org.reflections.Reflections.<init>(Reflections.java:140)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
        at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: javax.servlet.jsp.JspWriter
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
        ... 11 more



[2022-05-21 04:28:34,769] DEBUG expanded subtype java.lang.ref.Reference -> java.lang.ref.SoftReference (org.reflections.Reflections)
[2022-05-21 04:28:34,770] DEBUG expanded subtype java.nio.channels.ReadableByteChannel -> java.nio.channels.ScatteringByteChannel (org.reflections.Reflections)
[2022-05-21 04:28:34,770] DEBUG expanded subtype java.nio.channels.Channel -> java.nio.channels.ReadableByteChannel (org.reflections.Reflections)
[2022-05-21 04:28:34,770] DEBUG expanded subtype java.io.Closeable -> java.nio.channels.Channel (org.reflections.Reflections)
[2022-05-21 04:28:34,770] DEBUG expanded subtype java.lang.AutoCloseable -> java.io.Closeable (org.reflections.Reflections)
[2022-05-21 04:28:34,775] DEBUG expanded subtype java.nio.channels.Channel -> java.nio.channels.WritableByteChannel (org.reflections.Reflections)
[2022-05-21 04:28:34,775] DEBUG expanded subtype java.io.Closeable -> java.nio.channels.Channel (org.reflections.Reflections)
[2022-05-21 04:28:34,775] DEBUG expanded subtype java.lang.AutoCloseable -> java.io.Closeable (org.reflections.Reflections)
[2022-05-21 04:28:34,779] DEBUG expanded subtype com.fasterxml.jackson.databind.deser.NullValueProvider -> com.fasterxml.jackson.databind.JsonDeserializer (org.reflections.Reflections)
[2022-05-21 04:28:34,789] DEBUG expanded subtype java.lang.Iterable -> java.util.Collection (org.reflections.Reflections)
[2022-05-21 04:28:34,792] DEBUG expanded subtype java.util.Collection -> java.util.Queue (org.reflections.Reflections)
[2022-05-21 04:28:34,792] DEBUG expanded subtype java.lang.Iterable -> java.util.Collection (org.reflections.Reflections)
[2022-05-21 04:28:34,794] DEBUG expanded subtype java.util.concurrent.ExecutorService -> java.util.concurrent.AbstractExecutorService (org.reflections.Reflections)
[2022-05-21 04:28:34,795] DEBUG expanded subtype java.util.concurrent.Executor -> java.util.concurrent.ExecutorService (org.reflections.Reflections)
[2022-05-21 04:28:34,798] WARN could not get type for name javax.servlet.jsp.el.VariableResolver from any class loader (org.reflections.Reflections)
org.reflections.ReflectionsException: could not get type for name javax.servlet.jsp.el.VariableResolver
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:312)
        at org.reflections.Reflections.expandSuperTypes(Reflections.java:382)
        at org.reflections.Reflections.<init>(Reflections.java:140)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.<init>(DelegatingClassLoader.java:441)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:331)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:268)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.registerPlugin(DelegatingClassLoader.java:260)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initPluginLoader(DelegatingClassLoader.java:229)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:206)
        at org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:61)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:93)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)
Caused by: java.lang.ClassNotFoundException: javax.servlet.jsp.el.VariableResolver
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.kafka.connect.runtime.isolation.PluginClassLoader.loadClass(PluginClassLoader.java:104)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:310)
        ... 11 more


[2022-05-21 04:28:40,574] DEBUG [Thread[org.reflections-scanner-2,5,main]] scanning file:/usr/share/java/kafka/netty-transport-4.1.73.Final.jar (org.reflections.Reflections)
[2022-05-21 04:28:40,592] DEBUG [Thread[org.reflections-scanner-1,5,main]] scanning file:/etc/kafka-connect/jars/* (org.reflections.Reflections)
[2022-05-21 04:28:40,593] WARN could not create Vfs.Dir from url. ignoring the exception and continuing (org.reflections.Reflections)
org.reflections.ReflectionsException: could not create Vfs.Dir from url, no matching UrlType was found [file:/etc/kafka-connect/jars/*]
either use fromURL(final URL url, final List<UrlType> urlTypes) or use the static setDefaultURLTypes(final List<UrlType> urlTypes) or addDefaultURLTypes(UrlType urlType) with your specialized UrlType.
        at org.reflections.vfs.Vfs.fromURL(Vfs.java:114)
        at org.reflections.vfs.Vfs.fromURL(Vfs.java:96)
        at org.reflections.Reflections.scan(Reflections.java:257)
        at org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader$InternalReflections.scan(DelegatingClassLoader.java:449)
        at org.reflections.Reflections.lambda$scan$0(Reflections.java:213)
        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)




[2022-05-21 04:28:42,823] ERROR Stopping due to error (org.apache.kafka.connect.cli.ConnectDistributed)
org.apache.kafka.common.config.ConfigException: Invalid value "1" for configuration offset.storage.replication.factor: Not a number of type SHORT
        at org.apache.kafka.common.config.ConfigDef.parseType(ConfigDef.java:742)
        at org.apache.kafka.common.config.ConfigDef.parseValue(ConfigDef.java:490)
        at org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:483)
        at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:108)
        at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:129)
        at org.apache.kafka.connect.runtime.WorkerConfig.<init>(WorkerConfig.java:452)
        at org.apache.kafka.connect.runtime.distributed.DistributedConfig.<init>(DistributedConfig.java:405)
        at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:95)
        at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:80)

OneCricketeer · 21 May 2022 07:30

This is the reason it won’t start, so focus on one error at a time

ConfigException: Invalid value "1" for configuration offset.storage.replication.factor: Not a number of type SHORT

system · 20 June 2022 07:31

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Kafka connect getting fail to submit task Kafka Connect	1	494	28 March 2024
Errors with ES sink connector Kafka Connect	2	4693	19 May 2021
Custom partitioner for S3 Sink Connector Kafka Connect	2	3520	7 March 2022
New version Kafka Connect FileSystem Connector Kafka Connect	1	2987	4 March 2021
S3 Sink Connector fails with the location key constraint Kafka Connect	1	2361	15 October 2022

ERROR Invalid connector status type class and ERROR Invalid task status type class

Related Topics