Greetings,
I have a working kafka installation on my laptop.
I installed confluent-ksqldb-0.29.0 into /opt in Ubuntu Linux.
When I execute: “sudo /opt/confluent/bin/ksql-server-start /opt/confluent/etc/ksqldb/ksql-server.properties” I get the following error:
[2023-09-25 10:00:14,305] INFO KsqlConfig values:
ksql.access.validator.enable = auto
ksql.assert.schema.default.timeout.ms = 1000
ksql.assert.topic.default.timeout.ms = 1000
ksql.authorization.cache.expiry.time.secs = 30
ksql.authorization.cache.max.entries = 10000
ksql.cast.strings.preserve.nulls = true
ksql.connect.basic.auth.credentials.file =
ksql.connect.basic.auth.credentials.reload = false
ksql.connect.basic.auth.credentials.source = NONE
ksql.connect.request.headers.plugin = null
ksql.connect.request.timeout.ms = 5000
ksql.connect.url = http://localhost:8083
ksql.connect.worker.config =
ksql.create.or.replace.enabled = true
ksql.endpoint.migrate.query = true
ksql.error.classifier.regex =
ksql.extension.dir = ext
ksql.headers.columns.enabled = true
ksql.hidden.topics = [_confluent.*, __confluent.*, _schemas, __consumer_offsets, __transaction_state, connect-configs, connect-offsets, connect-status, connect-statuses]
ksql.insert.into.values.enabled = true
ksql.internal.topic.min.insync.replicas = 1
ksql.internal.topic.replicas = 1
ksql.json_sr.converter.deserializer.enabled = true
ksql.lambdas.enabled = true
ksql.metastore.backup.location =
ksql.metrics.extension = null
ksql.metrics.tags.custom =
ksql.nested.error.set.null = true
ksql.new.query.planner.enabled = false
ksql.output.topic.name.prefix =
ksql.persistence.default.format.key = KAFKA
ksql.persistence.default.format.value = null
ksql.persistence.wrap.single.values = null
ksql.persistent.prefix = query_
ksql.properties.overrides.denylist = []
ksql.pull.queries.enable = true
ksql.query.cleanup.shutdown.timeout.ms = 30000
ksql.query.error.max.queue.size = 10
ksql.query.persistent.active.limit = 2147483647
ksql.query.persistent.max.bytes.buffering.total = -1
ksql.query.pull.enable.standby.reads = false
ksql.query.pull.forwarding.timeout.ms = 20000
ksql.query.pull.interpreter.enabled = true
ksql.query.pull.limit.clause.enabled = true
ksql.query.pull.max.allowed.offset.lag = 9223372036854775807
ksql.query.pull.max.concurrent.requests = 2147483647
ksql.query.pull.max.hourly.bandwidth.megabytes = 2147483647
ksql.query.pull.max.qps = 2147483647
ksql.query.pull.metrics.enabled = true
ksql.query.pull.range.scan.enabled = true
ksql.query.pull.router.thread.pool.size = 50
ksql.query.pull.stream.enabled = true
ksql.query.pull.table.scan.enabled = true
ksql.query.pull.thread.pool.size = 50
ksql.query.push.v2.alos.enabled = true
ksql.query.push.v2.catchup.consumer.msg.window = 50
ksql.query.push.v2.continuation.tokens.enabled = false
ksql.query.push.v2.enabled = false
ksql.query.push.v2.interpreter.enabled = true
ksql.query.push.v2.latest.reset.age.ms = 30000
ksql.query.push.v2.max.catchup.consumers = 5
ksql.query.push.v2.max.hourly.bandwidth.megabytes = 2147483647
ksql.query.push.v2.metrics.enabled = true
ksql.query.push.v2.new.latest.delay.ms = 5000
ksql.query.push.v2.registry.installed = false
ksql.query.retry.backoff.initial.ms = 15000
ksql.query.retry.backoff.max.ms = 900000
ksql.query.status.running.threshold.seconds = 300
ksql.query.transient.max.bytes.buffering.total = -1
ksql.queryanonymizer.cluster_namespace = null
ksql.queryanonymizer.logs_enabled = true
ksql.readonly.topics = [_confluent.*, __confluent.*, _schemas, __consumer_offsets, __transaction_state, connect-configs, connect-offsets, connect-status, connect-statuses]
ksql.runtime.feature.shared.enabled = false
ksql.schema.registry.url =
ksql.security.extension.class = null
ksql.service.id = default_
ksql.shared.runtimes.count = 2
ksql.sink.window.change.log.additional.retention = 1000000
ksql.source.table.materialization.enabled = true
ksql.streams.shutdown.timeout.ms = 300000
ksql.suppress.buffer.size.bytes = -1
ksql.suppress.enabled = true
ksql.timestamp.throw.on.invalid = false
ksql.transient.prefix = transient_
ksql.transient.query.cleanup.service.enable = true
ksql.transient.query.cleanup.service.initial.delay.seconds = 600
ksql.transient.query.cleanup.service.period.seconds = 600
ksql.udf.collect.metrics = false
ksql.udf.enable.security.manager = true
ksql.udfs.enabled = true
ksql.variable.substitution.enable = true
ksql.websocket.connection.max.timeout.ms = 3600000
metric.reporters = []
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
ssl.endpoint.identification.algorithm = https
ssl.engine.factory.class = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.certificate.chain = null
ssl.keystore.key = null
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLSv1.3
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.certificates = null
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
(io.confluent.ksql.util.KsqlConfig:369)
[2023-09-25 10:00:14,365] INFO KsqlRestConfig values:
access.control.allow.headers = []
access.control.allow.methods = []
access.control.allow.origin =
authentication.method = NONE
authentication.realm =
authentication.roles = [*]
authentication.skip.paths = []
ksql.advertised.listener = null
ksql.authentication.plugin.class = null
ksql.endpoint.logging.ignored.paths.regex =
ksql.endpoint.logging.log.queries = false
ksql.healthcheck.interval.ms = 5000
ksql.heartbeat.check.interval.ms = 200
ksql.heartbeat.discover.interval.ms = 2000
ksql.heartbeat.enable = false
ksql.heartbeat.missed.threshold.ms = 3
ksql.heartbeat.send.interval.ms = 100
ksql.heartbeat.thread.pool.size = 3
ksql.heartbeat.window.ms = 2000
ksql.idle.connection.timeout.seconds = 86400
ksql.internal.http2.max.pool.size = 3000
ksql.internal.listener = null
ksql.internal.ssl.client.authentication = NONE
ksql.lag.reporting.enable = false
ksql.lag.reporting.send.interval.ms = 5000
ksql.local.commands.location =
ksql.logging.server.rate.limited.request.paths =
ksql.logging.server.rate.limited.response.codes =
ksql.max.push.queries = 100
ksql.server.command.blocked.threshold.error.ms = 15000
ksql.server.command.response.timeout.ms = 5000
ksql.server.command.topic.migration.enabled = NONE
ksql.server.command.topic.rate.limit = 1.7976931348623157E308
ksql.server.error.messages = class io.confluent.ksql.rest.DefaultErrorMessages
ksql.server.exception.uncaught.handler.enable = false
ksql.server.install.dir = /opt/confluent
ksql.server.precondition.max.backoff.ms = 5000
ksql.server.preconditions = []
ksql.server.sni.check.enable = false
ksql.server.websockets.num.threads = 5
ksql.ssl.keystore.alias.external =
ksql.ssl.keystore.alias.internal =
ksql.verticle.instances = 16
ksql.worker.pool.size = 100
listeners = [http://0.0.0.0:8088]
query.stream.disconnect.check = 1000
ssl.cipher.suites = []
ssl.client.auth = false
ssl.client.authentication = NONE
ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
ssl.key.password = [hidden]
ssl.keystore.location =
ssl.keystore.password = [hidden]
ssl.keystore.reload = false
ssl.keystore.type = JKS
ssl.keystore.watch.location =
ssl.truststore.location =
ssl.truststore.password = [hidden]
ssl.truststore.type = JKS
(io.confluent.ksql.rest.server.KsqlRestConfig:369)
[2023-09-25 10:00:14,367] INFO KsqlConfig values:
ksql.access.validator.enable = auto
ksql.assert.schema.default.timeout.ms = 1000
ksql.assert.topic.default.timeout.ms = 1000
ksql.authorization.cache.expiry.time.secs = 30
ksql.authorization.cache.max.entries = 10000
ksql.cast.strings.preserve.nulls = true
ksql.connect.basic.auth.credentials.file =
ksql.connect.basic.auth.credentials.reload = false
ksql.connect.basic.auth.credentials.source = NONE
ksql.connect.request.headers.plugin = null
ksql.connect.request.timeout.ms = 5000
ksql.connect.url = http://localhost:8083
ksql.connect.worker.config =
ksql.create.or.replace.enabled = true
ksql.endpoint.migrate.query = true
ksql.error.classifier.regex =
ksql.extension.dir = ext
ksql.headers.columns.enabled = true
ksql.hidden.topics = [_confluent.*, __confluent.*, _schemas, __consumer_offsets, __transaction_state, connect-configs, connect-offsets, connect-status, connect-statuses]
ksql.insert.into.values.enabled = true
ksql.internal.topic.min.insync.replicas = 1
ksql.internal.topic.replicas = 1
ksql.json_sr.converter.deserializer.enabled = true
ksql.lambdas.enabled = true
ksql.metastore.backup.location =
ksql.metrics.extension = null
ksql.metrics.tags.custom =
ksql.nested.error.set.null = true
ksql.new.query.planner.enabled = false
ksql.output.topic.name.prefix =
ksql.persistence.default.format.key = KAFKA
ksql.persistence.default.format.value = null
ksql.persistence.wrap.single.values = null
ksql.persistent.prefix = query_
ksql.properties.overrides.denylist = []
ksql.pull.queries.enable = true
ksql.query.cleanup.shutdown.timeout.ms = 30000
ksql.query.error.max.queue.size = 10
ksql.query.persistent.active.limit = 2147483647
ksql.query.persistent.max.bytes.buffering.total = -1
ksql.query.pull.enable.standby.reads = false
ksql.query.pull.forwarding.timeout.ms = 20000
ksql.query.pull.interpreter.enabled = true
ksql.query.pull.limit.clause.enabled = true
ksql.query.pull.max.allowed.offset.lag = 9223372036854775807
ksql.query.pull.max.concurrent.requests = 2147483647
ksql.query.pull.max.hourly.bandwidth.megabytes = 2147483647
ksql.query.pull.max.qps = 2147483647
ksql.query.pull.metrics.enabled = true
ksql.query.pull.range.scan.enabled = true
ksql.query.pull.router.thread.pool.size = 50
ksql.query.pull.stream.enabled = true
ksql.query.pull.table.scan.enabled = true
ksql.query.pull.thread.pool.size = 50
ksql.query.push.v2.alos.enabled = true
ksql.query.push.v2.catchup.consumer.msg.window = 50
ksql.query.push.v2.continuation.tokens.enabled = false
ksql.query.push.v2.enabled = false
ksql.query.push.v2.interpreter.enabled = true
ksql.query.push.v2.latest.reset.age.ms = 30000
ksql.query.push.v2.max.catchup.consumers = 5
ksql.query.push.v2.max.hourly.bandwidth.megabytes = 2147483647
ksql.query.push.v2.metrics.enabled = true
ksql.query.push.v2.new.latest.delay.ms = 5000
ksql.query.push.v2.registry.installed = false
ksql.query.retry.backoff.initial.ms = 15000
ksql.query.retry.backoff.max.ms = 900000
ksql.query.status.running.threshold.seconds = 300
ksql.query.transient.max.bytes.buffering.total = -1
ksql.queryanonymizer.cluster_namespace = null
ksql.queryanonymizer.logs_enabled = true
ksql.readonly.topics = [_confluent.*, __confluent.*, _schemas, __consumer_offsets, __transaction_state, connect-configs, connect-offsets, connect-status, connect-statuses]
ksql.runtime.feature.shared.enabled = false
ksql.schema.registry.url =
ksql.security.extension.class = null
ksql.service.id = default_
ksql.shared.runtimes.count = 2
ksql.sink.window.change.log.additional.retention = 1000000
ksql.source.table.materialization.enabled = true
ksql.streams.shutdown.timeout.ms = 300000
ksql.suppress.buffer.size.bytes = -1
ksql.suppress.enabled = true
ksql.timestamp.throw.on.invalid = false
ksql.transient.prefix = transient_
ksql.transient.query.cleanup.service.enable = true
ksql.transient.query.cleanup.service.initial.delay.seconds = 600
ksql.transient.query.cleanup.service.period.seconds = 600
ksql.udf.collect.metrics = false
ksql.udf.enable.security.manager = true
ksql.udfs.enabled = true
ksql.variable.substitution.enable = true
ksql.websocket.connection.max.timeout.ms = 3600000
metric.reporters = []
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
ssl.endpoint.identification.algorithm = https
ssl.engine.factory.class = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.certificate.chain = null
ssl.keystore.key = null
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLSv1.3
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.certificates = null
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
(io.confluent.ksql.util.KsqlConfig:369)
[2023-09-25 10:00:14,422] ERROR Failed to start KSQL (io.confluent.ksql.rest.server.KsqlServerMain:96)
java.lang.UnsupportedOperationException: The Security Manager is deprecated and will be removed in a future release
at java.base/java.lang.System.setSecurityManager(System.java:429)
at io.confluent.ksql.function.UserFunctionLoader.newInstance(UserFunctionLoader.java:158)
at io.confluent.ksql.rest.server.KsqlServerMain.loadFunctions(KsqlServerMain.java:128)
at io.confluent.ksql.rest.server.KsqlServerMain.main(KsqlServerMain.java:80)
Here is my ksql-server.properties file:
#
# Copyright 2018 Confluent Inc.
#
# Licensed under the Confluent Community License (the "License"); you may not use
# this file except in compliance with the License. You may obtain a copy of the
# License at
#
# http://www.confluent.io/confluent-community-license
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OF ANY KIND, either express or implied. See the License for the
# specific language governing permissions and limitations under the License.
#
#------ Endpoint config -------
### HTTP ###
# The URL the KSQL server will listen on:
# The default is any IPv4 interface on the machine.
# NOTE: If set to wildcard or loopback set 'advertised.listener' to enable pull queries across machines
listeners=http://0.0.0.0:8088
#listeners=http://localhost:8088
# Use the 'listeners' line below for any IPv6 interface on the machine.
# listeners=http://[::]:8088
# If running a multi-node cluster across multiple machines and 'listeners' is set to a wildcard or loopback address
# 'advertised.listener' must be set to the URL other KSQL nodes should use to reach this node.
# advertised.listener=?
### HTTPS ###
# To switch KSQL over to communicating using HTTPS comment out the 'listeners' line above
# uncomment and complete the properties below.
# See: https://docs.ksqldb.io/en/latest/operate-and-deploy/installation/server-config/security/#configure-the-cli-for-https
#
# listeners=https://0.0.0.0:8088
# advertised.listener=?
# ssl.truststore.location=?
# ssl.truststore.password=?
# ssl.keystore.location=?
# ssl.keystore.password=?
# ssl.key.password=?
#------ Logging config -------
# Automatically create the processing log topic if it does not already exist:
ksql.logging.processing.topic.auto.create=true
# Automatically create a stream within KSQL for the processing log:
ksql.logging.processing.stream.auto.create=true
# Uncomment the following if you wish the errors written to the processing log to include the
# contents of the row that caused the error.
# Note: care should be taken to restrict access to the processing topic if the data KSQL is
# processing contains sensitive information.
ksql.logging.processing.rows.include=true
#------- Metrics config --------
# Turn on collection of metrics of function invocations:
# ksql.udf.collect.metrics=true
#------ External service config -------
#------ Kafka -------
# The set of Kafka brokers to bootstrap Kafka cluster information from:
bootstrap.servers=localhost:9092
# Enable snappy compression for the Kafka producers
compression.type=snappy
#------ Connect -------
# uncomment the below to start an embedded Connect worker
# ksql.connect.worker.config=config/connect.properties
#------ Schema Registry -------
# Uncomment and complete the following to enable KSQL's integration to the Confluent Schema Registry:
# ksql.schema.registry.url=http://localhost:8081
state.dir=/var/lib/kafka-streams
Any assistance will be greatly appreciated.
Thanks in advance
iomari