[shiftmedia-libgnutls] download failure of gnulib cause build failure

[aberaud]

Operating system

Windows

Compiler

MSVC

Steps to reproduce the behavior

vcpkg install shiftmedia-libgnutls

Failure logs

C:\Users\runneradmin\AppData\Local\vcpkg\registries\git-trees\dcd9bcc539c9c95eb9c40a11f053bd2bad22e822: info: installing from git registry git+https://github.com/microsoft/vcpkg@dcd9bcc539c9c95eb9c40a11f053bd2bad22e822
Downloading https://github.com/ShiftMediaProject/gnutls/archive/3.8.7.tar.gz -> ShiftMediaProject-gnutls-3.8.7.tar.gz
Successfully downloaded ShiftMediaProject-gnutls-3.8.7.tar.gz
-- Extracting source D:/a/opendht/opendht/vcpkg/downloads/ShiftMediaProject-gnutls-3.8.7.tar.gz
-- Applying patch external-libtasn1.patch
-- Applying patch pkgconfig.patch
-- Using source at D:/a/opendht/opendht/vcpkg/buildtrees/shiftmedia-libgnutls/src/3.8.7-afcad25e4d.clean
Downloading https://git.savannah.gnu.org/gitweb/?p=gnulib.git;a=snapshot;h=3639c57;sf=tgz -> gnulib-3639c57.tar.gz
error: https://git.savannah.gnu.org/gitweb/?p=gnulib.git;a=snapshot;h=3639c57;sf=tgz: failed: status code 502
note: If you are using a proxy, please ensure your proxy settings are correct.
Possible causes are:
1. You are actually using an HTTP proxy, but setting HTTPS_PROXY variable to `https://address:port`.
This is not correct, because `https://` prefix claims the proxy is an HTTPS proxy, while your proxy (v2ray, shadowsocksr, etc...) is an HTTP proxy.
Try setting `http://address:port` to both HTTP_PROXY and HTTPS_PROXY instead.
2. If you are using Windows, vcpkg will automatically use your Windows IE Proxy Settings set by your proxy software. See: https://github.com/microsoft/vcpkg-tool/pull/77
The value set by your proxy might be wrong, or have same `https://` prefix issue.
3. Your proxy's remote server is out of service.
If you believe this is not a temporary download server failure and vcpkg needs to be changed to download this file from a different location, please submit an issue to https://github.com/Microsoft/vcpkg/issues
CMake Error at scripts/cmake/vcpkg_download_distfile.cmake:136 (message):
Error:   Download failed, halting portfile.
Call Stack (most recent call first):
  C:/Users/runneradmin/AppData/Local/vcpkg/registries/git-trees/dcd9bcc539c9c95eb9c40a11f053bd2bad22e822/portfile.cmake:16 (vcpkg_download_distfile)
  scripts/ports.cmake:206 (include)


error: building shiftmedia-libgnutls:x64-windows failed with: BUILD_FAILED
See https://learn.microsoft.com/vcpkg/troubleshoot/build-failures?WT.mc_id=vcpkg_inproduct_cli for more information.
Elapsed time to handle shiftmedia-libgnutls:x64-windows: 1.1 min

Additional context

Our CI breaks regularly because of frequent spurious download failures of gnulib from GNU servers (https://git.savannah.gnu.org).

This bug has already been reported in the past:
#46251
#46167

The core issue is that the GNU servers are not reliable and fail spuriously. This have been the case for years and may not be fixed anytime soon.
The proper solution is to download gnulib and other dependencies like nettle from an alternative server/mirror. It may also be possible to add a retry mechanism if sticking to GNU servers.

[dg0yt]

Our CI breaks regularly because of frequent spurious download failures of gnulib from GNU servers (https://git.savannah.gnu.org).

Your CI breaks because you don't use asset caching.

BTW upstream shiftmedia-libgnutls is archived since four months. Time to get it out of your CI.

[aberaud]

Your CI breaks because you don't use asset caching.

It doesn't fail 2% of the times but more like 30%.
We do build caching, but at this failure rate, that isn't enough to prevent regular issues.