How are you copying the new plugins to the plugin path? Maybe you are overwriting the directory during the copy process of the new custom plugin?
To include a new plugin to your current Kafka Connect installation, you should copy the jars inside of one of your plugin.path directories. To avoid mistakes, you can create a completely new folder a add it to your plugin.path variable. There is a very good explanation by Robin Moffatt in this blog post.