CFK restClient Auth Error

I see the exception below in my kafka pods logs but I don’t know where or what principle (component) that is causing the 401 is, so how do I debug it? There is nothing in of interest in confluent components logs.


[ERROR] 2022-12-19 04:00:16,450 [pool-43-thread-459] io.confluent.security.auth.client.rest.RestClient lambda$submit$0 - Unexpected exception sending HTTP Request.
io.confluent.security.auth.client.rest.exceptions.RestClientException: Unauthorized; error code: 401
at io.confluent.security.auth.client.rest.RestClient$HTTPRequestSender.lambda$submit$0(RestClient.java:430)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
[ERROR] 2022-12-19 04:00:16,450 [pool-44-thread-1] io.confluent.security.auth.client.rest.RestClient run - Error while refreshing active metadata server urls, retrying
io.confluent.security.auth.client.rest.exceptions.RestClientException: Unauthorized; error code: 401
at io.confluent.security.auth.client.rest.RestClient$HTTPRequestSender.lambda$submit$0(RestClient.java:430)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
[ERROR] 2022-12-19 04:00:16,451 [pool-44-thread-1] io.confluent.security.auth.client.rest.RestClient run - Failed to fetch MDS URLs
io.confluent.security.auth.client.rest.exceptions.RestClientException: Unauthorized; error code: 401
at io.confluent.security.auth.client.rest.RestClient$HTTPRequestSender.lambda$submit$0(RestClient.java:430)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)