Kafka Broker does not receive all logs from docker containers

Ops
1

Hello,

I am shipping logs from docker containers to a Kafka server running on a Linux VM server. The connection is OKAY and logs from some containers are received. I do not understand why all container logs are not reaching kafka server.

This is the path from filebeat in docker:

- '/var/lib/docker/containers/*/*.log'
2

Do you know that the issue is the Kafka broker not receiving the logs? Could it be that filebeat isn’t picking them up and sending them?

What diagnosis results have you found so far? Is there a pattern to when the logs get dropped? What proportion of logs are missed?