Confluent Cloud and exporting Metric data to ELK

Ops
1

Hi we would like to export metric and maybe some log data from Confluent Cloud into the [
ELK Stack - Elasticsearch and Kibana.

Currently it’s uncertain if we will use ELK On-premises or ELK Cloud

I was wondering if their is a best practice for this ?

I found this:
https://docs.confluent.io/cloud/current/monitoring/metrics-api.html#discover-available-resources

Were you write a connector to extract metric data from Confluent Cloud.

Would something like this be the way to go ?

2

Hey @henriksped209

welcome to the forum :slight_smile:

Maybe you could use prometheus as intermediate stack,
collect confluent cloud metrics and then query prometheus from your ELK stack.

Never tried to query Prometheus from ELK stack, though querying confluent cloud with prometheus works as expected.

Best,
michael

3

Hi Michael

Thanks for the tip. I have used Prometheus before. We used metricbeat to scrape metrics from prometheus on a Openshift installation. So maybe it could work here to