Docker tags missing from docker hub

[joecorall]

See https://islandora.slack.com/archives/CM6F4C4VA/p1761058621592109

I tested some random tags and they're working locally for me with isle-site-template

ISLANDORA_TAG=4.3.18
ISLANDORA_TAG=4.1.6
ISLANDORA_TAG=6.0.2

4.3.1 is broke because alpaca/drupal/nginx are missing from dockerhub

islandora/nginx:4.3.9 is missing

if this is just dockerhub deleting our tags randomly (which there is evidence of after a google search) or is our cleanup task deleting these (the logic looks like it wouldn't be deleting e.g. 4.3.1)

[aOelschlager]

I just checked and most of the 4.x.x tags for nginx are missing in dockerhub.

[joecorall]

I just checked and most of the 4.x.x tags for nginx are missing in dockerhub.

I think that might the one most people don't pull often (islandora/drupal is the base for building the Drupal container). So my suspicion is given the lack of docker pull on the nginx image, docker is pruning those on some ttl

[nigelgbanks]

Should we have a policy about retention? If some organization hasn't updated in ages and deletes their only copy of the image or has some failure, they'd really be in the mess. We could store archival images in Digital Ocean as a backup for such cases, as we already have an account.

[ysuarez]

FYI, over the weekend I checked the availability of various Islandora buildkit images using a simple script I created, and here are my results.
Islandora buildkit image availability data

[ysuarez]

Here is a quick summary of the missing images, if a tag version has no comment, it means there are no images (though some may have 1)

Tag: 3.2.2 (has ALL images)
Tag: 3.5.5
Tag: 3.5.6
Tag: 3.5.7
Tag: 3.5.8
Tag: 3.5.9
Tag: 3.6.0
Tag 4.x.x
Tag: 4.0.0
Tag: 4.0.1
Tag: 4.0.2
Tag: 4.0.3
Tag: 4.0.4
Tag: 4.0.5
Tag: 4.0.6 (has most images)
Tag: 4.0.7
Tag: 4.0.8
Tag: 4.0.9
Tag: 4.0.10
Tag: 4.0.11
Tag: 4.0.12
Tag: 4.0.13
Tag: 4.1.0
Tag: 4.1.1
Tag: 4.1.2
Tag: 4.1.3 (has ALL images, though not nginx)
Tag: 4.1.4
Tag: 4.1.5
Tag: 4.1.6 (hast ALL images, though not nginx)
Tag: 4.1.7
Tag: 4.2.0
Tag: 4.2.1
Tag: 4.2.2
Tag: 4.3.0
Tag: 4.3.1
Tag: 4.3.2
Tag: 4.3.3
Tag: 4.3.4
Tag: 4.3.5
Tag: 4.3.6
Tag: 4.3.7 (has ALL images, though not nginx)
Tag: 4.3.8
Tag: 4.3.9 (has ALL images, though not nginx)
Tag: 4.3.10
Tag: 4.3.11
Tag: 4.3.12
Tag: 4.3.13
Tag: 4.3.14
Tag: 4.3.15
Tag: 4.3.16
Tag: 4.3.17
Tag: 4.3.18 (has ALL images)
Tag: 5.0.0 (has most images)
Tag: 5.0.1 (has 1/2 of images)
Tag: 5.1.0
Tag: 5.1.1
Tag: 5.1.2 (missing mariadb, alpaca, nginx)
Tag: 5.1.3 (missing mariadb)
Tag: 5.1.4 (missing mariadb)
Tag: 5.1.5 (has ALL images)
Tag: 6.0.0 (missing fits)
Tag: 6.0.1 (has ALL images)
Tag: 6.0.2 (has ALL images)
Tag: 6.0.3 (has ALL images)
Tag: 6.0.4 (has ALL images)
Tag: 6.0.5 (has ALL images)
Tag: 6.0.6 (has ALL images)
Tag: 6.0.7 (has ALL images)

[ysuarez]

FYI, here is the syntax my bash script uses to check the existence of specific images...
docker buildx imagetools inspect islandora/solr:3.5.5

[joecorall]

As discussed at the tech call, we should explore GHCR as a potential replacement for Docker Hub.

This PR would start pushing images to GHCR, too: #497 e.g. https://github.com/Islandora-Devops/isle-buildkit/pkgs/container/base

I think we should wait something like six months and evaluate dockerhub vs GHCR. We'll probably want to continue this dual registry approach as a disaster recovery remediation indefinitely.

For those on old buildkit tags 2/3/4/5 that want to upgrade to 6, I'd advise looking at the major release notes for the versions between your current version and the targeted version. If a given major version bump won't break your setup, check the next version. e.g. if you're on version 2.x the only thing that could break you from going to version 5.x would be if php 8.1 -> 8.2 breaks your drupal site (3.x) you're using matomo (4.x) or the code server (5.x)

• https://github.com/Islandora-Devops/isle-buildkit/releases/tag/3.0.0
• https://github.com/Islandora-Devops/isle-buildkit/releases/tag/4.0.0
• https://github.com/Islandora-Devops/isle-buildkit/releases/tag/5.0.0
• https://github.com/Islandora-Devops/isle-buildkit/releases/tag/6.0.0