Skip to content

CI: reduce flakiness in the libssh2, trackmemory, and socat jobs #10969

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
SparkiDev merged 3 commits into from
Jul 24, 2026
+17 −12
Merged

CI: reduce flakiness in the libssh2, trackmemory, and socat jobs #10969

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
ae1ea40
Retry flaky libssh2 Docker tests with make recheck
Frauschi Jul 22, 2026
c5518f2
Correct stale make-check timing weights in trackmemory CI
Frauschi Jul 22, 2026
adb0da7
Tolerate timing-flaky non-TLS socat tests via expect_fail
Frauschi Jul 22, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion .github/workflows/libssh2.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,12 @@ jobs:

- name: Run libssh2 tests
working-directory: libssh2
run: make -j check
# The Docker OpenSSH-server tests hit a container-readiness race
# ("Failed getting banner"): the client connects before sshd in the
# freshly started container is ready to send its banner. Re-run only
# the tests that did not pass, so a transient race does not fail the
# job while a genuine failure still does.
run: make -j check || make recheck || make recheck

- name: Confirm libssh2 built with wolfSSL
run: ldd libssh2/src/.libs/libssh2.so | grep wolfssl
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/socat.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,9 +50,9 @@ jobs:
matrix:
include:
- socat_version: "1.8.0.0"
expect_fail: "36,64,146,155,156,216,307,309,310,321,386,399,402,403,459,460,467,468,475,478,491,492,528,529"
expect_fail: "36,64,146,155,156,205,216,227,307,309,310,321,386,399,402,403,459,460,467,468,475,478,491,492,528,529"
- socat_version: "1.8.0.3"
expect_fail: "146,155,156,307,321,386,399,402,459,460,467,468,475,478,491,492,495,528,529"
expect_fail: "23,146,155,156,307,321,386,399,402,459,460,467,468,475,478,491,492,495,528,529"
steps:
- name: Checkout wolfSSL CI actions
uses: actions/checkout@v5
Expand Down
18 changes: 9 additions & 9 deletions .github/workflows/trackmemory.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
name: WOLFSSL_TRACK_MEMORY Tests

# START OF COMMON SECTION
Expand Down Expand Up @@ -70,25 +70,25 @@
run: |
cat > "$RUNNER_TEMP/trackmemory-configs.json" <<'EOF'
[
{"name": "all-noasm-wolfentropy", "minutes": 3,
{"name": "all-noasm-wolfentropy", "minutes": 6.3,
"configure": ["--disable-asm", "--enable-wolfEntropy",
"--enable-smallstackcache", "--enable-smallstack", "--enable-all",
"CFLAGS=-DWC_RNG_SEED_CB -DWOLFSSL_TRACK_MEMORY -DWOLFSSL_DEBUG_MEMORY -DNO_WOLFSSL_CIPHER_SUITE_TEST"]},
{"name": "all-trace-errcodes", "minutes": 2.5,
"configure": ["--enable-all", "--enable-debug-trace-errcodes",
"CFLAGS=-DWC_RNG_SEED_CB -DWOLFSSL_TRACK_MEMORY -DWOLFSSL_DEBUG_MEMORY"]},
{"name": "all-smallstack", "minutes": 2.5,
"configure": ["--enable-smallstack", "--enable-all",
"CFLAGS=-DWC_RNG_SEED_CB -DWOLFSSL_TRACK_MEMORY -DWOLFSSL_DEBUG_MEMORY"]},
{"name": "all-smallstack-cache-trace", "minutes": 2.5,
{"name": "all-smallstack-cache-trace", "minutes": 4.1,
"configure": ["--enable-smallstackcache", "--enable-smallstack",
"--enable-all", "--enable-debug-trace-errcodes",
"CFLAGS=-DWC_RNG_SEED_CB -DWOLFSSL_TRACK_MEMORY -DWOLFSSL_DEBUG_MEMORY"]},
{"name": "all-wolfentropy", "minutes": 2.5,
{"name": "all-wolfentropy", "minutes": 4.1,
"comment": "smallstackcache coverage here is crucial for the Linux kernel module when targeting a kernel with the randomness patch (linuxkm/patches/) applied. Don't combine wolfEntropy with the full TLS cipher suite test - the implicit wc_InitRng()s in each suite have an enormous CPU footprint.",
"configure": ["--enable-wolfEntropy", "--enable-smallstackcache",
"--enable-smallstack", "--enable-all",
"CFLAGS=-DWC_RNG_SEED_CB -DWOLFSSL_TRACK_MEMORY -DWOLFSSL_DEBUG_MEMORY -DNO_WOLFSSL_CIPHER_SUITE_TEST"]},
{"name": "all-trace-errcodes", "minutes": 3.9,
"configure": ["--enable-all", "--enable-debug-trace-errcodes",
"CFLAGS=-DWC_RNG_SEED_CB -DWOLFSSL_TRACK_MEMORY -DWOLFSSL_DEBUG_MEMORY"]},
{"name": "all-smallstack", "minutes": 3.9,
"configure": ["--enable-smallstack", "--enable-all",
"CFLAGS=-DWC_RNG_SEED_CB -DWOLFSSL_TRACK_MEMORY -DWOLFSSL_DEBUG_MEMORY"]},
{"name": "all-intelrdseed", "minutes": 2.5,
"configure": ["--enable-intelrdseed", "--enable-smallstackcache",
"--enable-smallstack", "--enable-all",
Expand Down
Loading