Redpanda Console (previously known as Kowl) is a Web UI, that allows you to explore and find messages in Kafka, provides an overview about topic configuration, consumer groups, brokers etc. It is designed to be hosted by a platform team, so that the initial setup including SASL, TLS etc. only has to be made once for everyone - however you can also run it locally using docker (compose). It’s open source and licensed under BSL.
Consumer groups: List all your active consumer groups along with their active group offsets, edit group offsets (by group, topic or partition) or delete a consumer group.
Topic overview: Browse through the list of your Kafka topics, check their configuration, space usage, list all consumers who consume a single topic or watch partition details (such as low and high water marks, message count, …), embed topic documentation from a git repository and more.
Cluster overview: List ACLs, available brokers, their space usage, rack id and other information to get a high level overview of your brokers in your cluster.
Schema registry: List all Avro, Protobuf or JSON schemas within your schema registry.
Kafka Connect: Manage connectors from multiple connect clusters, patch configs, view their current state or restart tasks.
Disclaimer: I’m one of the authors and work for Redpanda. Redpanda acquired Kowl in 2022.
Nice! Do you have any plans of adding kSQL console support to it?
Actually no plans at the moment, but feature requests via the GitHub issues are always welcome. We try to prioritize by community feedback.
However for kSQL I’m not sure if we are even allowed to offer features around it (because of the Confluent license). Maybe someone from Confluent can shed some light on this?
We have added support for Kafka connect. It has some unique features that no other GUI tool can offer so far and hence I believe for those that are looking for a UI for Kafka connect management - Kowl is one of the best options (and also free/opensource):
- Multi cluster support
- Visual Setup Wizard to deploy new connectors (includes validation and SMT support) - works for all available connectors
- CRUD operations for all connectors
Here you can see a short GIF showing the Kafka connect support: https://twitter.com/cloudhut_kowl/status/1461009177959182343
Nowadays the UI looks more modern than the oirignal GIF shows, but the post can not be edited unfortunately.
So far, Kowl is the best tool I’ve found for monitoring Kafka.
I’ve been able to configure almost everything.
The only thing that I was not able to connect was Schema-Registry.
I have Confluent SR running in a Docker container and no matter what I put in
SCHEMAREGISTRY_URLS, Kowl does not see/connect to the registry.
Could you give me a hint of what I could be doing wrong?
This is how I create the Kowl container:
docker run -p 8077:8080 -d \
-e KAFKA_BROKERS=hostIP:9099 \
-e CONNECT_ENABLED=true \
-e CONNECT_CLUSTERS_NAME=clustername \
-e CONNECT_CLUSTERS_URL=http://hostIP:8083 \
-e SCHEMAREGISTRY_ENABLED=true \
-e SCHEMAREGISTRY_URLS=[“http://hostIP:8085/”] \
--name KowlKafkaMonitor quay.io/cloudhut/kowl:master
The registry is working fine, I’ve checked that to be sure the problem wasn’t there.
Thank you !!!
I’ve had the same problem you had. To fix it you need to put KAFKA_ prefix before SCHEMAREGISTRY… as stated here. Hope it helps.
I’ll update this post with the latest information & screenshots. The Software is still open source, the licenses can be found here: console/licenses at master · redpanda-data/console · GitHub . 99% of all users can still use it, unless you want to offer it in a commercial SaaS - this is my understanding.