one thing which might cause the issue could be kubernetes built-in garbage collection
perhaps k8s engine deletes the images
see Garbage Collection | Kubernetes
did you check the logs of the failed containers?
… I’m trying to figure out if some how what we’re seeing is the native docker… “registry” or a minikube registry.
hmmm,
let me do test quickly, going to manually install a registry image. and see if it stays there… or get’s cleaned …
G
… here is a interesting little test case…
I created a docker-compose.yml
used :bitnami-docker-couchdb/docker-compose.yml at 86f2d36aceac9be999c5c3c7019250b63221f282 · bitnami/bitnami-docker-couchdb · GitHub
See the below flow… the downloaded docker image is still present, and restarting the stack does not pull it again. so this “problem” is sitting with the cp-all-in-one stack.
G
Georges-MacBook-Pro.local:/Users/george > cd Desktop/ProjectsCommon/couchdb/
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > vi docker-compose.yaml
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker-compose up -d
Docker Compose is now in the Docker CLI, try `docker compose up`
Creating network "couchdb_default" with the default driver
Creating volume "couchdb_couchdb_data" with local driver
Pulling couchdb (docker.io/bitnami/couchdb:3)...
3: Pulling from bitnami/couchdb
4fb7b694fe70: Pull complete
a361f8254651: Pull complete
d846d252e1d1: Pull complete
229fb265a676: Pull complete
c9148987e185: Pull complete
7865e2875764: Pull complete
eb04ab50acb3: Pull complete
635901113b16: Pull complete
9369a9f9dc8e: Pull complete
b4af16be6390: Pull complete
Digest: sha256:5d552ec584cd913ecb5777fe9536079072997e973fbd94af8238d9e577c28f61
Status: Downloaded newer image for bitnami/couchdb:3
Creating couchdb_couchdb_1 ... done
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker-compose ps
Name Command State Ports
-----------------------------------------------------------------------------------------------------------------------------------
couchdb_couchdb_1 /opt/bitnami/scripts/couch ... Up 0.0.0.0:4369->4369/tcp, 0.0.0.0:5984->5984/tcp, 0.0.0.0:9100->9100/tcp
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
bitnami/couchdb 3 fac91b81dff9 20 hours ago 157MB
registry 2 1fd8e1b0bb7e 3 weeks ago 26.2MB
gcr.io/k8s-minikube/kicbase v0.0.20 c6f4fc187bc1 4 weeks ago 1.09GB
k8s.gcr.io/kube-proxy v1.19.7 9d368f4517bb 3 months ago 118MB
k8s.gcr.io/kube-apiserver v1.19.7 c15e4f843f01 3 months ago 119MB
k8s.gcr.io/kube-scheduler v1.19.7 4fa642720eea 3 months ago 45.6MB
k8s.gcr.io/kube-controller-manager v1.19.7 67b3bca112d1 3 months ago 111MB
k8s.gcr.io/etcd 3.4.13-0 0369cf4303ff 8 months ago 253MB
k8s.gcr.io/coredns 1.7.0 bfe3a36ebd25 10 months ago 45.2MB
k8s.gcr.io/pause 3.2 80d28bedfe5d 15 months ago 683kB
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker-compose down
Stopping couchdb_couchdb_1 ... done
Removing couchdb_couchdb_1 ... done
Removing network couchdb_default
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
bitnami/couchdb 3 fac91b81dff9 20 hours ago 157MB
registry 2 1fd8e1b0bb7e 3 weeks ago 26.2MB
gcr.io/k8s-minikube/kicbase v0.0.20 c6f4fc187bc1 4 weeks ago 1.09GB
k8s.gcr.io/kube-proxy v1.19.7 9d368f4517bb 3 months ago 118MB
k8s.gcr.io/kube-apiserver v1.19.7 c15e4f843f01 3 months ago 119MB
k8s.gcr.io/kube-controller-manager v1.19.7 67b3bca112d1 3 months ago 111MB
k8s.gcr.io/kube-scheduler v1.19.7 4fa642720eea 3 months ago 45.6MB
k8s.gcr.io/etcd 3.4.13-0 0369cf4303ff 8 months ago 253MB
k8s.gcr.io/coredns 1.7.0 bfe3a36ebd25 10 months ago 45.2MB
k8s.gcr.io/pause 3.2 80d28bedfe5d 15 months ago 683kB
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker-compose up -d
Docker Compose is now in the Docker CLI, try `docker compose up`
Creating network "couchdb_default" with the default driver
Creating couchdb_couchdb_1 ... done
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker-compose ps
Name Command State Ports
-----------------------------------------------------------------------------------------------------------------------------------
couchdb_couchdb_1 /opt/bitnami/scripts/couch ... Up 0.0.0.0:4369->4369/tcp, 0.0.0.0:5984->5984/tcp, 0.0.0.0:9100->9100/tcp
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
bitnami/couchdb 3 fac91b81dff9 20 hours ago 157MB
registry 2 1fd8e1b0bb7e 3 weeks ago 26.2MB
gcr.io/k8s-minikube/kicbase v0.0.20 c6f4fc187bc1 4 weeks ago 1.09GB
k8s.gcr.io/kube-proxy v1.19.7 9d368f4517bb 3 months ago 118MB
k8s.gcr.io/kube-apiserver v1.19.7 c15e4f843f01 3 months ago 119MB
k8s.gcr.io/kube-scheduler v1.19.7 4fa642720eea 3 months ago 45.6MB
k8s.gcr.io/kube-controller-manager v1.19.7 67b3bca112d1 3 months ago 111MB
k8s.gcr.io/etcd 3.4.13-0 0369cf4303ff 8 months ago 253MB
k8s.gcr.io/coredns 1.7.0 bfe3a36ebd25 10 months ago 45.2MB
k8s.gcr.io/pause 3.2 80d28bedfe5d 15 months ago 683kB
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker-compose down
Stopping couchdb_couchdb_1 ... done
Removing couchdb_couchdb_1 ... done
Removing network couchdb_default
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker-compose ps
Name Command State Ports
------------------------------
Georges-MacBook-Pro.local:/Users/george/Desktop/ProjectsCommon/couchdb > docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
bitnami/couchdb 3 fac91b81dff9 20 hours ago 157MB
registry 2 1fd8e1b0bb7e 3 weeks ago 26.2MB
gcr.io/k8s-minikube/kicbase v0.0.20 c6f4fc187bc1 4 weeks ago 1.09GB
k8s.gcr.io/kube-proxy v1.19.7 9d368f4517bb 3 months ago 118MB
k8s.gcr.io/kube-scheduler v1.19.7 4fa642720eea 3 months ago 45.6MB
k8s.gcr.io/kube-apiserver v1.19.7 c15e4f843f01 3 months ago 119MB
k8s.gcr.io/kube-controller-manager v1.19.7 67b3bca112d1 3 months ago 111MB
k8s.gcr.io/etcd 3.4.13-0 0369cf4303ff 8 months ago 253MB
k8s.gcr.io/coredns 1.7.0 bfe3a36ebd25 10 months ago 45.2MB
k8s.gcr.io/pause 3.2 80d28bedfe5d 15 months ago 683kB
Georges-MacBook-Pro.local
just out of curiosity
what’s the output of
minikube cache list
Nothing…
and I spoke to a friend thats allot better at containers etc than me and he informed me the command that I thought might have had impact, def will not… so this is not minikube’s doing.
also went digging through docker settings, figured maybe there is a auto prune, but not… and also with the test above with couchdb it also does not hold as a possibility.
G