We are using a HDInsight kafka cluster to connect to kafaka server. It has 3 worker nodes.
AS of now if there is any production issue and need to debug the issue one person from our team who has access to the head node as admin/root user does an SSH and checks the logs. This is not an ideal way to do.
We are looking for a way to check this logs without using the admin/root user credentials.
As per some initial research I found that the ideal way is to create an azure kafka event hub that they access this info from using an azure connection strings to securely connect.
But i am unable to find any documentation or details on how to proceed.
Please help me if I am missing something or if there is a better approach to achieve this.
Thanks a lot in advance for your help.