Im new to the confluent cloud and scraping the metrics with the Prometheus config, which lists each cluster, connector, or ksql db by the ID. If any of those objects are removed for some reason. The scrape will break with a 403 unauthorized error as that specified object no longer exists.
Is there a way to scrape at an ORG level and not be dependent on listing each clusterID.
or if that ID is not available, continue without failing
could you elaborate a bit more?
who did you configure prometheus?
I guess you are using the metrics api?
This is correct, using the metrics api with the generated config
- job_name: Confluent Cloud
thanks for the input.
need to check by myself whether it’s possible.
will come back once tested
same error here
afaik there is no possibility to automate this out of the box
one thing which might work is to get the cluster ids via confluent cli and create the
prometheus.yml by script or similar.
will try this tomorrow