Some packages cannot be built 3: Revenge of the Xiph

[TomJo2000]

• The last full rebuild run is about 6 months old,
  and with the recent merger of Make auto updates rate-limit aware #22994
  now seems like to good time to refresh it, so here we go again.

Important

Build validation should be done without use of the "fast build" -i/-I flags!

termux-packages/build-package.sh

Lines 425 to 426 in 4bf2156

	[ "$TERMUX_ON_DEVICE_BUILD" = "false" ] && echo " -i Download and extract dependencies instead of building them."
	echo " -I Download and extract dependencies instead of building them, keep existing $TERMUX_BASE_DIR files."

e.g.

./scripts/run-docker.sh ./build-package.sh -f [package [, ...]]

We want to verify that every package can be "bootstrapped" without the need for pre-compiled dependencies.

Results of building all packages as of February 28th, 2025

• Built from commit 456945a
• Many of the failures listed showed up as a result of texinfo being unbuildable at that commit. Since that has now been fixed, future tests like this should have fewer failures in reverse dependencies of texinfo.
• Built using build-validation.sh and build-validation-spreadsheet.py
• This test took 10 days to run locally
• many packages containing Rust code, like mdbook-epub, failed to build non-interactively at tiers 2, 3 and 4 because of this prompt:
  • Reversed (or previously applied) patch detected! Assume -R? [n]
  • These are not currently handled as failures in the below results because, "Enter" was interactively mashed in the terminal emulator whenever these appeared.
  • However, these would be de facto failures in any non-interactive CI run, such as a self-hosted GitHub Actions runner, that uses this build-validation.sh.

termux-packages/packages/mdbook-epub/build.sh

Lines 20 to 24 in cb3bd6e

	local _patch=$TERMUX_PKG_BUILDER_DIR/mdbook-src-renderer-html_handlebars-helpers-navigation.rs.diff
	local d
	for d in $CARGO_HOME/registry/src/*/mdbook-*; do
	patch --silent -p1 -d ${d} < ${_patch} || :
	done

Packages that failed to build

Package	With -I	No -I	Building all	Repeat building all	Comment
aapt	🟩	🟩	🟩	🟥
alass	🟩	🟥	🟥	🟥
alsa-plugins	🟩	🟥	🟥	🟥
android-tools	🟩	🟩	🟩	🟥
apt	🟩	🟩	🟥	🟥
apt-file	🟩	🟩	🟥	🟥
aptitude	🟩	🟩	🟥	🟥
ardour	🟥	🟥	🟥	🟥
argon2	🟩	🟩	🟩	🟥
asymptote	🟩	🟩	🟥	🟥
atomvm	🟩	🟩	🟥	🟥
atril	🟥	🟥	🟥	🟥
atuin	🟩	🟩	🟥	🟥
aubio	🟩	🟥	🟥	🟥
audacious-plugins	🟥	🟥	🟥	🟥
audacity	🟥	🟥	🟥	🟥
avrdude	🟩	🟩	🟥	🟥
bgrep	🟥	🟥	🟥	🟥
borgbackup	🟩	🟩	🟩	🟥
cabal-install	🟩	🟥	🟥	🟥
calc	🟩	🟩	🟩	🟥
carbonyl	🟥	🟥	🟥	🟥
carbonyl-host-tools	🟥	🟥	🟥	🟥
cava	🟩	🟥	🟥	🟥
ccextractor	🟩	🟥	🟥	🟥
check	🟩	🟥	🟥	🟥
cherrytree	🟩	🟥	🟥	🟩
chocolate-doom	🟥	🟥	🟥	🟥
chromaprint	🟩	🟥	🟥	🟥
clutter-gst	🟩	🟥	🟥	🟥
clvk	🟩	🟩	🟥	🟥
cmus	🟩	🟥	🟥	🟥
codeblocks	🟥	🟥	🟥	🟥
composer	🟩	🟥	🟥	🟥
cookcli	🟩	🟩	🟥	🟥
cowsay	🟩	🟩	🟩	🟥
crystal	🟩	🟥	🟥	🟥
cuse	🟥	🟥	🟥	🟥
dart	🟩	🟩	🟩	🟥
dateutils	🟩	🟩	🟩	🟥
deadbeef	🟥	🟥	🟥	🟥
distant	🟩	🟩	🟩	🟥
dnsutils	🟩	🟥	🟥	🟥
doge	🟥	🟥	🟥	🟥	will be fixed by #23699
dopewars	🟩	🟩	🟩	🟥
dosbox	🟥	🟥	🟥	🟥
dosbox-x	🟥	🟥	🟥	🟥
dotnet8.0	🟩	🟩	🟥	🟥
dotnet9.0	🟩	🟩	🟥	🟥
dropbear	🟩	🟩	🟩	🟥
dunst	🟥	🟥	🟥	🟥
e2tools	🟩	🟩	🟩	🟥
electrum	🟩	🟥	🟥	🟩
emacs	🟩	🟩	🟥	🟥
emacs-x	🟩	🟥	🟥	🟥
epiphany	🟥	🟥	🟥	🟥
espeak	🟩	🟥	🟥	🟥
et	🟩	🟩	🟩	🟥
evince	🟥	🟥	🟥	🟥
far2l	🟩	🟩	🟥	🟥
fastfetch	🟩	🟥	🟥	🟥
ffmpeg	🟩	🟥	🟥	🟥	Tracked in #23697
ffmpegthumbnailer	🟩	🟥	🟥	🟥
ffplay	🟥	🟥	🟥	🟥
filelight	🟥	🟥	🟥	🟥
findomain	🟩	🟩	🟥	🟥
fio	🟩	🟩	🟥	🟥
firefox	🟥	🟥	🟥	🟥
flameshot	🟩	🟥	🟥	🟥
fluidsynth	🟩	🟥	🟥	🟥
freerdp	🟥	🟥	🟥	🟥
frida	🟥	🟥	🟥	🟥	Returning from #21130
frogcomposband	🟩	🟥	🟥	🟩
gap	🟩	🟩	🟩	🟥
gdal	🟩	🟩	🟩	🟥
gdb	🟩	🟩	🟩	🟥
gegl	🟩	🟥	🟥	🟥
gforth	🟩	🟩	🟥	🟥
ghc-libs	🟥	🟥	🟥	🟥	Returning from #21130
gimp	🟥	🟥	🟥	🟥
gimp-lqr-plugin	🟥	🟥	🟥	🟥
gnunet	🟩	🟥	🟥	🟥
gobang	🟩	🟩	🟥	🟥
godot	🟥	🟥	🟥	🟥
gomp	🟩	🟥	🟥	🟥
gpac	🟩	🟥	🟥	🟥
gpg-crypter	🟩	🟥	🟥	🟥
groonga	🟩	🟩	🟩	🟥
gst-libav	🟩	🟥	🟥	🟥
gst-plugins-bad	🟩	🟥	🟥	🟥
gst-plugins-base	🟩	🟥	🟥	🟥
gst-plugins-good	🟩	🟥	🟥	🟥
gst-plugins-ugly	🟩	🟥	🟥	🟥
gst-python	🟩	🟥	🟥	🟥
gw	🟩	🟥	🟥	🟥
handbrake	🟥	🟥	🟥	🟥
hangover-wine	🟥	🟥	🟥	🟥
heimer	🟩	🟥	🟥	🟥
helix	🟩	🟩	🟩	🟥
hstr	🟩	🟩	🟩	🟥
hugin	🟥	🟥	🟥	🟥
i3status	🟥	🟥	🟥	🟥
ices	🟩	🟩	🟩	🟥
imgflo	🟩	🟥	🟥	🟥
inkscape	🟩	🟥	🟥	🟥
iptables	🟩	🟩	🟥	🟥
ircd-irc2	🟥	🟥	🟥	🟥	Returning from #21130
jftui	🟩	🟥	🟥	🟥
kdenlive	🟥	🟥	🟥	🟥
kf6-breeze-icons	🟩	🟩	🟩	🟥
kf6-kfilemetadata	🟥	🟥	🟥	🟥
kf6-kio	🟥	🟥	🟥	🟥
kf6-kjobwidgets	🟥	🟥	🟥	🟥
kf6-knotifications	🟥	🟥	🟥	🟥
kf6-knotifyconfig	🟥	🟥	🟥	🟥
kf6-kwallet	🟥	🟥	🟥	🟥
kf6-purpose	🟥	🟥	🟥	🟥
kid3	🟥	🟥	🟥	🟥
komorebi	🟥	🟥	🟥	🟥
labwc	🟩	🟥	🟥	🟥
ldc	🟩	🟩	🟥	🟥
lenmus	🟥	🟥	🟥	🟥	Returning from #21130
lgogdownloader	🟩	🟩	🟥	🟥
libao	🟩	🟥	🟥	🟥
libapt-pkg-perl	🟩	🟩	🟥	🟥
libarrow-cpp	🟩	🟩	🟩	🟥
libcanberra	🟥	🟥	🟥	🟥
libdart	🟩	🟩	🟥	🟥
libduckdb	🟩	🟩	🟥	🟥
libgnustep-base	🟩	🟩	🟥	🟥
libgts	🟩	🟩	🟩	🟥
libhtmlcxx	🟩	🟩	🟥	🟥
libiodbc	🟩	🟩	🟩	🟥
liblightning	🟩	🟩	🟥	🟥
libmpeg2	🟩	🟩	🟥	🟥
libncnn	🟩	🟩	🟩	🟥
libopenmpt	🟩	🟥	🟥	🟥
libosmium	🟩	🟩	🟥	🟥
libosmpbf	🟩	🟩	🟩	🟥
libotr	🟩	🟩	🟩	🟥
libprotozero	🟩	🟩	🟥	🟥
librocksdb	🟩	🟩	🟥	🟥
libseat	🟩	🟩	🟥	🟥
libspice-server	🟩	🟥	🟥	🟥
libssh	🟩	🟩	🟥	🟥
libtd	🟩	🟩	🟥	🟥
libtheora	🟩	🟩	🟥	🟥
libtommath	🟩	🟩	🟩	🟥
libtranscript	🟩	🟩	🟩	🟥
liburcu	🟥	🟥	🟥	🟥
libxmlrpc	🟩	🟩	🟩	🟥
lilypond	🟩	🟩	🟩	🟥
lite-xl	🟥	🟥	🟥	🟥
llvm-mingw-w64-tools	🟩	🟩	🟩	🟥
love	🟥	🟥	🟥	🟥
lua-language-server	🟩	🟩	🟩	🟥
lua-lpeg	🟩	🟩	🟩	🟥
luarocks	🟩	🟩	🟥	🟥
lxqt-panel	🟥	🟥	🟥	🟥
manim	🟩	🟥	🟥	🟥
marco	🟥	🟥	🟥	🟥
mariadb	🟩	🟩	🟥	🟥
maxima	🟩	🟩	🟩	🟥
mcfly	🟩	🟩	🟥	🟥
mediamtx	🟩	🟩	🟩	🟥
megacmd	🟩	🟥	🟥	🟥
mesa	🟩	🟥	🟥	🟥
mesa-demos	🟩	🟥	🟥	🟥
mgba	🟥	🟥	🟥	🟥
milkytracker	🟥	🟥	🟥	🟥
mindforger	🟩	🟥	🟥	🟥
minidlna	🟩	🟥	🟥	🟥
minimodem	🟩	🟥	🟥	🟥
mlt	🟥	🟥	🟥	🟥
movit	🟥	🟥	🟥	🟥
mp3gain	🟩	🟥	🟥	🟥
mpd	🟩	🟥	🟥	🟥
mpdscribble	🟩	🟥	🟥	🟥
mpg123	🟩	🟥	🟥	🟥
mplayer	🟩	🟥	🟥	🟥
mpv	🟩	🟥	🟥	🟥
mpv-x	🟥	🟥	🟥	🟥
mu	🟩	🟥	🟥	🟥
musescore	🟩	🟥	🟥	🟥
nala	🟩	🟥	🟥	🟥
navidrome	🟩	🟥	🟥	🟥
ncpamixer	🟩	🟥	🟥	🟥
ncspot	🟩	🟥	🟥	🟥
ncspot-mpris	🟥	🟥	🟥	🟥
neovim	🟩	🟩	🟩	🟥
notcurses	🟩	🟥	🟥	🟥
ntfs-3g	🟩	🟩	🟥	🟥
nxengine	🟥	🟥	🟥	🟥
obconf-qt	🟩	🟩	🟩	🟥
obfs4proxy	🟩	🟩	🟥	🟥
oleo	🟩	🟩	🟩	🟥
ollama	🟩	🟩	🟩	🟥
opencv	🟥	🟥	🟥	🟥
openethereum	🟩	🟩	🟥	🟥
openfoam	🟥	🟥	🟥	🟥	Returning from #21130
openjdk-17	🟩	🟩	🟩	🟥
openjdk-21	🟩	🟩	🟩	🟥
openscad	🟥	🟥	🟥	🟥	Returning from #21130
openttd	🟥	🟥	🟥	🟥
orca	🟥	🟥	🟥	🟥
oshu	🟥	🟥	🟥	🟥
osmium-tool	🟩	🟩	🟥	🟥
otter-browser	🟥	🟥	🟥	🟥
pari	🟩	🟩	🟩	🟥
parole	🟥	🟥	🟥	🟥
pavucontrol	🟥	🟥	🟥	🟥
pavucontrol-qt	🟥	🟥	🟥	🟥
pcaudiolib	🟩	🟥	🟥	🟥
pcsx-rearmed	🟥	🟥	🟥	🟥
pdfgrep	🟩	🟩	🟩	🟥
pgroonga	🟩	🟥	🟥	🟥
php	🟩	🟥	🟥	🟥
php-apcu	🟩	🟥	🟥	🟥
php-imagick	🟩	🟥	🟥	🟥
php-psr	🟩	🟥	🟥	🟥
php-redis	🟩	🟥	🟥	🟥
php-zephir-parser	🟩	🟥	🟥	🟥
phpmyadmin	🟩	🟥	🟥	🟥
pianobar	🟩	🟥	🟥	🟥
pidgin	🟩	🟥	🟥	🟥
pika	🟩	🟩	🟥	🟥
pinentry	🟩	🟩	🟩	🟥
pinentry-gtk	🟩	🟥	🟥	🟥
pipewire	🟩	🟥	🟥	🟥
polybar	🟥	🟥	🟥	🟥
pong2	🟥	🟥	🟥	🟥
postgis	🟩	🟥	🟥	🟥
praat	🟥	🟥	🟥	🟥
pulseaudio	🟩	🟥	🟥	🟥
pypy3	🟥	🟥	🟥	🟥	fixed by #22906
pyqt5	🟥	🟥	🟥	🟥
python-apt	🟩	🟩	🟥	🟥
python-contourpy	🟩	🟩	🟩	🟥
python-cryptography	🟩	🟥	🟥	🟩
python-msgpack	🟩	🟩	🟩	🟥
python-onnxruntime	🟩	🟥	🟥	🟥
python-pyarrow	🟩	🟥	🟥	🟩
python-pyqtwebengine	🟥	🟥	🟥	🟥
python-qscintilla	🟥	🟥	🟥	🟥
python-scipy	🟩	🟩	🟩	🟥
python-tflite-runtime	🟩	🟥	🟥	🟥
python-tldp	🟩	🟥	🟥	🟩
python-torch	🟩	🟥	🟥	🟩
python-torchaudio	🟩	🟥	🟥	🟥
python-torchvision	🟩	🟥	🟥	🟥
qb64	🟩	🟩	🟩	🟥
qemu-system-x86-64	🟥	🟥	🟥	🟥
qemu-system-x86-64-headless	🟩	🟥	🟥	🟥
qrsspig	🟩	🟥	🟥	🟥
qt-creator	🟥	🟥	🟥	🟥	Returning from #21130
qt5-qtmultimedia	🟥	🟥	🟥	🟥
qt5-qtwebengine	🟩	🟥	🟥	🟥
qt6-qtbase	🟩	🟩	🟩	🟥
qt6-qtdeclarative	🟩	🟩	🟩	🟥
qt6-qtmultimedia	🟥	🟥	🟥	🟥
qt6-qttools	🟩	🟩	🟩	🟥
quassel	🟥	🟥	🟥	🟥
rdircd	🟩	🟥	🟥	🟩
recordmydesktop	🟩	🟩	🟥	🟥
recutils	🟩	🟩	🟩	🟥
rhythmbox	🟩	🟥	🟥	🟥
rizin	🟩	🟩	🟥	🟥
rnote	🟥	🟥	🟥	🟥
rpm	🟩	🟩	🟩	🟥
rsgain	🟩	🟥	🟥	🟥
rsnapshot	🟩	🟩	🟥	🟥
rust	🟩	🟥	🟥	🟥
sabnzbd	🟩	🟥	🟥	🟩
schismtracker	🟥	🟥	🟥	🟥
scrcpy	🟥	🟥	🟥	🟥
sdcv	🟥	🟥	🟥	🟥
sdl	🟥	🟥	🟥	🟥
sdl-image	🟥	🟥	🟥	🟥
sdl-mixer	🟥	🟥	🟥	🟥
sdl-net	🟥	🟥	🟥	🟥
sdl-ttf	🟥	🟥	🟥	🟥
sdl2	🟥	🟥	🟥	🟥
sdl2-compat	🟥	🟥	🟥	🟥
sdl2-gfx	🟥	🟥	🟥	🟥
sdl2-image	🟥	🟥	🟥	🟥
sdl2-mixer	🟥	🟥	🟥	🟥
sdl2-net	🟥	🟥	🟥	🟥
sdl2-pango	🟥	🟥	🟥	🟥
sdl2-ttf	🟥	🟥	🟥	🟥
sdl3	🟥	🟥	🟥	🟥
shairport-sync	🟩	🟥	🟥	🟥
shellcheck	🟩	🟥	🟥	🟥
shotcut	🟥	🟥	🟥	🟥
simulavr	🟩	🟩	🟩	🟥
simulide	🟥	🟥	🟥	🟥
smalltalk	🟩	🟥	🟥	🟥
snapcast-server	🟩	🟥	🟥	🟥
solidity	🟩	🟩	🟥	🟥
sox	🟩	🟥	🟥	🟥
speechd	🟩	🟥	🟥	🟥
spek	🟥	🟥	🟥	🟥
squeezelite	🟩	🟥	🟥	🟥
sratom	🟩	🟥	🟥	🟩
srt2vobsub	🟩	🟥	🟥	🟥
sshping	🟩	🟩	🟥	🟥
subversion	🟩	🟩	🟩	🟥
suil	🟩	🟩	🟩	🟥
surf	🟥	🟥	🟥	🟥
sway	🟩	🟥	🟥	🟥
swi-prolog	🟩	🟩	🟥	🟥
swift	🟥	🟥	🟥	🟥	See discussion in #23144
swiftshader	🟩	🟩	🟩	🟥
synaptic	🟩	🟥	🟥	🟥
sysprop	🟩	🟩	🟩	🟥
taskwarrior	🟩	🟩	🟩	🟥
telegram-bot-api	🟩	🟩	🟥	🟥
tenki-php	🟩	🟥	🟥	🟥
termplay	🟩	🟥	🟥	🟥
termshark	🟩	🟩	🟥	🟥
texinfo	🟥	🟥	🟥	🟥	fixed by #23554
the-powder-toy	🟥	🟥	🟥	🟥
thunderbird	🟥	🟥	🟥	🟥	Returning from #21130
tigervnc	🟩	🟥	🟥	🟥
timg	🟩	🟥	🟥	🟥
tinyemu	🟥	🟥	🟥	🟥
tinygo	🟩	🟩	🟥	🟥
tizonia	🟩	🟥	🟥	🟥
tmate	🟩	🟩	🟥	🟥
tor	🟩	🟩	🟥	🟥
torsocks	🟩	🟩	🟥	🟥
toxic	🟩	🟩	🟩	🟥
tshark	🟩	🟩	🟥	🟥
tsmuxergui	🟥	🟥	🟥	🟥
tuxpaint	🟥	🟥	🟥	🟥
tvheadend	🟥	🟥	🟥	🟥	Returning from #21130
unar	🟩	🟩	🟥	🟥
units	🟩	🟥	🟥	🟩
unpaper	🟩	🟥	🟥	🟥
vala-panel-appmenu	🟥	🟥	🟥	🟥
valgrind	🟥	🟥	🟥	🟥	Returning from #21130 , see discussion in #22758
vgmstream	🟩	🟥	🟥	🟥
vim-gtk	🟥	🟥	🟥	🟥
virglrenderer	🟩	🟥	🟥	🟥
vkmark	🟩	🟩	🟥	🟥
vlc	🟩	🟥	🟥	🟥
vlc-qt	🟥	🟥	🟥	🟥
vulkan-validation-layers	🟥	🟥	🟥	🟥	Returning from #21130
wasi-libc	🟩	🟩	🟥	🟥
wasmedge	🟩	🟩	🟩	🟥
webkit2gtk-4.1	🟥	🟥	🟥	🟥
webkitgtk-6.0	🟥	🟥	🟥	🟥
weston	🟥	🟥	🟥	🟥
wine-stable	🟥	🟥	🟥	🟥
wireshark-qt	🟥	🟥	🟥	🟥
wlroots	🟩	🟥	🟥	🟥
wxmaxima	🟥	🟥	🟥	🟥
wxwidgets	🟥	🟥	🟥	🟥
xf86-input-void	🟩	🟥	🟥	🟥
xf86-video-dummy	🟩	🟥	🟥	🟥
xfce4-pulseaudio-plugin	🟥	🟥	🟥	🟥
xorg-server	🟩	🟥	🟥	🟥
xorg-server-xvfb	🟩	🟥	🟥	🟥
xorriso	🟥	🟥	🟥	🟥
xrdp	🟩	🟥	🟥	🟥
xwayland	🟩	🟥	🟥	🟥
ytui-music	🟩	🟥	🟥	🟥
z-push	🟩	🟥	🟥	🟥
zellij	🟩	🟩	🟥	🟥
zenity	🟥	🟥	🟥	🟥
zig	🟩	🟩	🟥	🟥
Totals	123	124	61	62	Only the lowest tier failed by each package is summed.

[robertkirkman]

I have started a build of all packages locally to collect this information, and I am using this script for now to do it.

build-validation.sh

#!/usr/bin/env bash

set -u -o pipefail

TERMUX_SCRIPTDIR=$(cd "$(realpath "$(dirname "$0")")"; pwd)

DOCKERSCRIPT="$TERMUX_SCRIPTDIR/scripts/run-docker.sh"

# a safe place outside of docker is just needed to temporarily store the results of the tests,
# and I preferred not to use anywhere in $HOME.
BUILDSTATUS_DIR="$TERMUX_SCRIPTDIR/build-validation-results"
rm -r "$BUILDSTATUS_DIR"
mkdir -p "$BUILDSTATUS_DIR"

PACKAGES=()

for PKG in $(find "$TERMUX_SCRIPTDIR"/{packages,root-packages,x11-packages} \
    -mindepth 1 -maxdepth 1 -exec basename {} \;); do
    PACKAGES+=("$PKG")
done

echo "==============="
echo "Build Order:"
echo "==============="
for PKG in "${PACKAGES[@]}"; do
	echo "$PKG"
done
echo "==============="

# $TIER indicates what degree of "bootstrappability" is being tested currently.
# higher values are considered as more difficult to build, or less likely to build successfully,
# so if a package passes a higher tier, it is considered that it most likely (with possible exceptions)
# would also pass all lower tiers if its build were tested at them too.

# TIER=4 - builds in a docker container that has already built all other packages that it is possible to build without the container being deleted
# TIER=3 - builds in a docker container that has been building many packages previously, but has not yet built all packages previously
# TIER=2 - builds in a clean docker container without the -I argument to build-package.sh
# TIER=1 - builds in a clean docker container with the -I argument to build-package.sh
TIER=3
export CONTAINER_NAME="tier-$TIER-termux-package-builder"
docker kill $CONTAINER_NAME
docker rm $CONTAINER_NAME

for PKG in "${PACKAGES[@]}"; do
    BUILDSTATUS_FILE="$BUILDSTATUS_DIR/$PKG"

    TIER=3
    export CONTAINER_NAME="tier-$TIER-termux-package-builder"

    echo "==============="
	echo "Building $PKG at tier $TIER..."
    echo "==============="

    if "$DOCKERSCRIPT" ./build-package.sh "$PKG"; then
        echo "passed tier $TIER" >> "$BUILDSTATUS_FILE"
        continue
    fi

    echo "==============="
    echo "$PKG failed to build at tier $TIER!"
    echo "==============="
    echo "failed tier $TIER" >> "$BUILDSTATUS_FILE"

    TIER=2
    export CONTAINER_NAME="tier-$TIER-termux-package-builder"
    docker kill $CONTAINER_NAME
    docker rm $CONTAINER_NAME

    echo "==============="
    echo "Building $PKG at tier $TIER..."
    echo "==============="
    if "$DOCKERSCRIPT" ./build-package.sh "$PKG"; then
        echo "passed tier $TIER" >> "$BUILDSTATUS_FILE"
        continue
    fi

    echo "==============="
    echo "$PKG failed to build at tier $TIER!"
    echo "==============="
    echo "failed tier $TIER" >> "$BUILDSTATUS_FILE"

    TIER=1
    export CONTAINER_NAME="tier-$TIER-termux-package-builder"
    docker kill $CONTAINER_NAME
    docker rm $CONTAINER_NAME

    echo "==============="
    echo "Building $PKG at tier $TIER..."
    echo "==============="
    if "$DOCKERSCRIPT" ./build-package.sh -I "$PKG"; then
        echo "passed tier $TIER" >> "$BUILDSTATUS_FILE"
        continue
    fi

    echo "==============="
    echo "$PKG failed to build at tier $TIER!"
    echo "==============="
    echo "failed tier $TIER" >> "$BUILDSTATUS_FILE"
done

TIER=4
export CONTAINER_NAME="tier-3-termux-package-builder"

for PKG in "${PACKAGES[@]}"; do
    BUILDSTATUS_FILE="$BUILDSTATUS_DIR/$PKG"

    echo "==============="
	echo "Building $PKG at tier $TIER..."
    echo "==============="

    if "$DOCKERSCRIPT" ./build-package.sh -f "$PKG"; then
        echo "passed tier $TIER" >> "$BUILDSTATUS_FILE"
        continue
    fi

    echo "==============="
    echo "$PKG failed to build at tier $TIER!"
    echo "==============="
    echo "failed tier $TIER" >> "$BUILDSTATUS_FILE"
done

After it finishes I will try to make another script and append it onto the end, that can parse the results out of the build-validation-results folder and generate the spreadsheet from them.

If it derails in an unanticipated way, or I end up needing to patch the termux-packages repository for some reason, I might need to edit this script further, but I am posting it here in case you would also like to use this, or have comments about the way I am doing it.

I would also like to mention somewhere that there are a few packages that are known to have fiddly behavior that may differ subtly between the CI and a local docker container (depending on what type of computer is running the Docker Daemon), so when results are obtained from a script like this one, the results for such packages can be taken with a grain of salt rather than as an objective claim about their status, and further information about each one's special behaviors can be found in discussions in their commit history/PRs. A short list of packages known to be in this category at the moment is:

• pypy
• pypy3
• swift
• python-cryptography

[robertkirkman]

Now it has been a day and I obtained results from 300 packages in that time, so it should only be a few days before I have a table of results for all packages. I've made this script to generate a spreadsheet from the results. It depends on csv2md.

build-validation-spreadsheet.py

#!/usr/bin/env python3

import os
import sys
import re
import csv
from csv2md.table import Table


class package:
    name = "unknown name"
    passed_tier_1 = "🟥"
    passed_tier_2 = "🟥"
    passed_tier_3 = "🟥"
    passed_tier_4 = "🟥"

    def __init__(
        self, name, passed_tier_1, passed_tier_2, passed_tier_3, passed_tier_4
    ):
        self.name = name
        self.passed_tier_1 = passed_tier_1
        self.passed_tier_2 = passed_tier_2
        self.passed_tier_3 = passed_tier_3
        self.passed_tier_4 = passed_tier_4


def passed_tier(results_directory, package_name, tier):
    with open(results_directory + "/" + package_name, "r") as results_file:
        for line in results_file:
            if "passed tier " + str(tier) in line:
                return True
    return False


def parse_results(results_directory):
    packages = []
    for package_name in os.listdir(results_directory):

        passed_tier_1 = "🟥"
        passed_tier_2 = "🟥"
        passed_tier_3 = "🟥"
        passed_tier_4 = "🟥"

        if passed_tier(results_directory, package_name, 1):
            passed_tier_1 = "🟩"

        if passed_tier(results_directory, package_name, 2):
            # if tier 3 was passed on the first try, this run assumes that the same package
            # would have also passed tier 1 and skips testing that, which is not entirely accurate
            passed_tier_1 = "🟩"
            passed_tier_2 = "🟩"

        if passed_tier(results_directory, package_name, 3):
            # if tier 3 was passed on the first try, this run assumes that the same package
            # would have also passed tiers 1 and 2 and skips testing those, which is not entirely accurate
            passed_tier_1 = "🟩"
            passed_tier_2 = "🟩"
            passed_tier_3 = "🟩"

        if passed_tier(results_directory, package_name, 4):
            passed_tier_4 = "🟩"

        if (
            passed_tier_1 == "🟩"
            and passed_tier_2 == "🟩"
            and passed_tier_3 == "🟩"
            and passed_tier_4 == "🟩"
        ):
            # do not append package to the list if it passed all tiers
            continue

        packages.append(
            package(
                package_name, passed_tier_1, passed_tier_2, passed_tier_3, passed_tier_4
            )
        )

    # sort alphabetically by package name
    packages.sort(key=lambda package: package.name)
    return packages


def generate_csv(packages, csv_filename):
    name_header = "**Package**"
    tier_1_header = "**With `-I`**"
    tier_2_header = "**No `-I`**"
    tier_3_header = "**Building all**"
    tier_4_header = "**Repeat building all**"
    comment_header = "**Comment**"
    with open(csv_filename, "w", newline="") as csv_file:
        csv_writer = csv.writer(csv_file)
        csv_fields = [
            name_header,
            tier_1_header,
            tier_2_header,
            tier_3_header,
            tier_4_header,
            comment_header,
        ]
        csv_writer.writerow(csv_fields)

        packages_failed_at_tier_1 = 0
        packages_failed_at_tier_2 = 0
        packages_failed_at_tier_3 = 0
        packages_failed_at_tier_4 = 0

        for package in packages:

            package_row = [
                "`" + package.name + "`",
                package.passed_tier_1,
                package.passed_tier_2,
                package.passed_tier_3,
                package.passed_tier_4,
                "",
            ]
            csv_writer.writerow(package_row)

            if package.passed_tier_1 == "🟥":
                packages_failed_at_tier_1 += 1
                continue

            if package.passed_tier_2 == "🟥":
                packages_failed_at_tier_2 += 1
                continue

            if package.passed_tier_3 == "🟥":
                packages_failed_at_tier_3 += 1
                continue

            packages_failed_at_tier_4 += 1

        totals_row = [
            "**Totals**",
            packages_failed_at_tier_1,
            packages_failed_at_tier_2,
            packages_failed_at_tier_3,
            packages_failed_at_tier_4,
            "Only the lowest tier failed by each package is summed.",
        ]
        csv_writer.writerow(totals_row)


def generate_md(csv_filename):
    with open(csv_filename) as csv_file:
        md_table = Table.parse_csv(csv_file)

    print(md_table.markdown())


def main():
    if len(sys.argv) != 3:
        print(
            "usage: "
            + sys.argv[0]
            + " [build validation results directory] [output csv filename]"
        )
        exit(1)

    results_directory = sys.argv[1]
    csv_filename = sys.argv[2]

    # get sorted list of packages that failed at least 1 tier
    packages = parse_results(results_directory)

    # save list of failed packages as csv file
    generate_csv(packages, csv_filename)

    # convert the csv to md and print to stdout
    generate_md(csv_filename)


if __name__ == "__main__":
    main()

[robertkirkman]

Unfortunately, the results shown in the sample for at least python-cryptography are a false negative, because something is wrong with my computer that is preventing me from building python-cryptography successfully in any docker container, which is not affecting other computers or CI. It is also not affecting KVM virtual machines running additional docker daemons on my affected computer, it is only affecting containers running on the bare metal docker daemon.

Because of that, I will probably need to figure out what is wrong with my computer and then restart the run of the build-validation.sh. I do not know yet whether something in build-validation.sh messed up my computer, or the problem was there beforehand.

[robertkirkman]

Ok, I believe I have fixed my computer.

• The error that was happening inside every container, only while building very specific packages like python-cryptography, was qemu-aarch64-static: Could not open '/system/bin/linker64': No such file or directory and very weirdly, installing aosp-libs (bionic-host) inside the docker container actually caused the error to go away, but only per-container, not for my entire computer
• The actual cause is probably that I had run docker run --rm --privileged aptman/qus -s -- -p aarch64 arm in the past on this computer while following this, because there were a lot of files in /proc/sys/fs/binfmt_misc/ on my computer.
• However, running docker run --rm --privileged aptman/qus -- -r as directed by this, which is supposed to uninstall aptman/qus, did not work for me, instead it printed sh: write error: File exists a lot of times and failed to make the files in /proc/sys/fs/binfmt_misc/ go away. I do not know exactly why that happens but I could speculate it might be because of some difference between Gentoo and the distros that aptman/qus was tested for.
• Instead, I was able to find this command by doing research, this command has worked to remove the files from /proc/sys/fs/binfmt_misc/ and causes python-cryptography to start compiling properly on my computer and not fail anymore.
  • for f in /proc/sys/fs/binfmt_misc/qemu-*; do echo '-1' | sudo tee "${f}"; done
  • I found this command in the source code of my OS here

Now I have restarted the run of build-validation.sh and hopefully it will not manifest too many more unexpected differences from CI.

[TomJo2000]

By the way @robertkirkman do feel free to update the spreadsheet in my original comment when you get new results.

That way we have them in one place.