Check the validity of the following URLs

[github-actions]

Please be so kind to double-check the validity of the following urls:
❌ https://www.dtls.nl/fair-data/byod/ is unreachable (Connection Error) (Attempt 1)
⚠️ https://indico.dkfz.de/event/1022/ returned status 404. It may be blocking bots. (Attempt 1)
❌ https://www.forschungsdaten.org/ is unreachable (Connection Error) (Attempt 1)
⚠️ https://zenodo.org/record/6602101 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6602101 returned status 429 (Attempt 1)
⚠️ https://www.sciencedirect.com/science/article/abs/pii/S0022283622000791 returned status 400 (Attempt 1)
⚠️ https://www.wiley.com/en-us/Standard+and+Super+Resolution+Bioimaging+Data+Analysis%3A+A+Primer-p-9781119096900 returned status 404. It may be blocking bots. (Attempt 1)
⚠️ https://zenodo.org/records/4334697 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.4334697 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/4328911 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.4328911 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/4317149 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.4317149 returned status 429 (Attempt 1)
⚠️ https://analyticalscience.wiley.com/do/10.1002/was.00050003/full/bioimagedataanalysis.pdf returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://zenodo.org/records/10083555 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10083555 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10815329 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10972692 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10990107 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10970869 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10970869 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11066250 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11066250 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11473803 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11473803 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11474407 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11474407 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11548617 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11548617 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/doi/10.5281/zenodo.10687658 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/doi/10.5281/zenodo.8349562 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/doi/10.5281/zenodo.8340247 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/doi/10.5281/zenodo.8139353 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/doi/10.5281/zenodo.10886749 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/doi/10.5281/zenodo.10793699 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11265038 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11107798 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11107798 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10942559 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10942559 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10816895 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10816895 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/4461261 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.4461261 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11472148 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11396199 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11396199 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/4748510 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.4748510 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/4630788 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.4630788 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.4748534 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.3778431 returned status 429 (Attempt 1)
⚠️ https://analyticalscience.wiley.com/do/10.1002/was.0004000267/ returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://analyticalscience.wiley.com/do/10.1002/was.0004000112/ returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://febs.onlinelibrary.wiley.com/doi/full/10.1002/1873-3468.14451 returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://onlinelibrary.wiley.com/doi/full/10.1111/jmi.13192 returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://onlinelibrary.wiley.com/doi/10.1111/jmi.13041 returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://doi.org/10.1093/bioinformatics/btab106 returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://rupress.org/jcb/article/189/5/777/35828/Metadata-matters-access-to-image-data-in-the-real returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://academic.oup.com/plcell/article/34/7/e1/6628764 returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://onlinelibrary.wiley.com/doi/10.1111/jmi.13317 returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://mitobo.informatik.uni-halle.de/ returned status 500 (Attempt 1)
⚠️ https://academic.oup.com/bioinformatics/article/28/19/2520/290322 returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://doi.org/10.1111/jmi.13227 returned status 403. It may be blocking bots. (Attempt 1)
❌ https://www.go-fair.org/resources/rdm-starter-kit/ is unreachable (Connection Error) (Attempt 1)
⚠️ https://web.library.uq.edu.au/blog/2022/03/five-great-reasons-share-your-research-data returned status 404. It may be blocking bots. (Attempt 1)
❌ https://www.go-fair.org/fair-principles/ is unreachable (Connection Error) (Attempt 1)
⚠️ https://www.sciencedirect.com/science/article/pii/S0022283622000791?via%3Dihub returned status 400 (Attempt 1)
❌ https://omero-fbi.fr/slides/elmi23_cfd/main.html#/title-slide is unreachable (Connection Error) (Attempt 1)
❌ https://github.com/royerlab/ultrack-i2k2024 is unreachable (Timeout) (Attempt 1)
⚠️ https://www.udemy.com/course/docker-mastery/?srsltid=AfmBOornR5gRqOg-4v8Nsap1z24CaPPUPxg8JzyqEGZ6MvW_dh-sf4Af&couponCode=ST2MT110724BNEW returned status 403. It may be blocking bots. (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.1472859 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/8314968 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.8314968 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13945179 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13945179 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/5847477 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.5847477 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10069368 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10069368 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11445843 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11445843 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14178789 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14178789 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14006558 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14006558 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13837146 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13837146 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11503289 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11503289 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13684187 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13684187 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13640979 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13640979 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13380289 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13380289 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/12699637 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.12699637 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11501662 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11501662 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11350689 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11350689 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11235513 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11235513 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11146807 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11146807 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11031747 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11031747 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10939520 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10939520 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10886750 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10886750 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10808486 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10793700 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10730424 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10730424 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/12546808 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.12546808 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7890311 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7890311 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10103316 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10103316 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/12547566 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.12547566 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14168603 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14168603 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14161633 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14161633 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14161289 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14161289 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14113714 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14113714 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13683167 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13683167 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13736218 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13736218 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13736240 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13736240 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13682928 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13682928 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13807114 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13807114 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13810879 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13810879 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/12578084 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.12578084 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7944877 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7944877 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7963020 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7963020 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7963006 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7963006 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7945018 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7945018 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.12166710 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10925217 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10889694 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10889694 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10839310 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10839310 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.8338931 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/8182154 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.8182154 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.8146412 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7788899 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7788899 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13739137 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.13739137 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/10460434 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.10460434 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/8372703 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.8372703 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7919117 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7919117 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7885379 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7885379 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7447491 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7447491 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7215114 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7215114 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7209862 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7209862 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7015307 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/6991106 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6991106 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/6953610 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6953610 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6834214 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/6646128 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6646128 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/6645978 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6645978 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/6554166 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6554166 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6535296 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6139958 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/5996883 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.5996883 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/6023317 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6023317 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/5121890 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.5121890 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/5101351 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.5101351 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13642395 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/12773657 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.12773657 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/12533989 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.12533989 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11637422 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11637422 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/11234863 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.11234863 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/7018750 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.7018750 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/6905931 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.6905931 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14197622 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14197622 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14234608 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14234608 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14235726 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14235726 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14278058 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14278058 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14287640 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14287640 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14281237 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14281237 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14268554 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14268554 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14418209 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14418209 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14381522 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14381522 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14186101 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14186101 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14035822 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14035822 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/13861026 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14510432 returned status 429 (Attempt 1)
⚠️ https://doi.org/10.5281/zenodo.14510432 returned status 429 (Attempt 1)
⚠️ https://zenodo.org/records/14626054 returned status 429 (Attempt 1)
⚠️ https://journals.biologists.com/jcs/article/137/20/jcs262139/362478/Making-the-most-of-bioimaging-data-through returned status 403. It may be blocking bots. (Attempt 1)

[marabuuu]

The result of running the url validity script locally and using the GitHub action looks very different.
Ideas why we run into these problems:

• zenodo and doi resolvers rate-limit automated tools → increase waiting time between retries, smart retry logic (based on status codes) (for certain codes like 429, 503, or connection errors, delay should increase (e.g., exponential backoff))

• bots are detected via advanced checks → rotate user agents (add randomisation)

• connection errors → increase timeout

• many services might block immediately, so retries don't help → add retry delay

• add more realistic headers