Skip to content

Commit 2bdd922

Browse files
npowclaude
andcommitted
fix(ci): increase devstack wait timeout and add failure diagnostics
The full-stack-test workflow was timing out on generate-configs with WAIT_TIMEOUT=600 (10 min). CI runners are slow and services sometimes need longer to initialize. - Increase WAIT_TIMEOUT from 600 to 900 (15 min) - Add timeout-minutes: 30 to prevent runaway jobs (was using 6h default) - Add diagnostic step on failure: dump tilt resource status and recent logs - Run teardown with if: always() so cleanup happens on failure too Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 31797a3 commit 2bdd922

1 file changed

Lines changed: 11 additions & 5 deletions

File tree

.github/workflows/full-stack-test.yml

Lines changed: 11 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,7 @@ on:
1111
jobs:
1212
test:
1313
runs-on: ubuntu-latest
14+
timeout-minutes: 30
1415

1516
steps:
1617
- name: Check out source
@@ -21,23 +22,28 @@ jobs:
2122
python -m pip install --upgrade pip
2223
pip install . kubernetes
2324
24-
2525
- name: Bring up the environment
2626
run: |
2727
echo "Starting environment in the background..."
2828
MINIKUBE_CPUS=2 metaflow-dev all-up &
29-
# Give time to spin up. Adjust as needed:
30-
WAIT_TIMEOUT=600 metaflow-dev wait-until-ready
29+
WAIT_TIMEOUT=900 metaflow-dev wait-until-ready
3130
3231
- name: Wait & run flow
3332
run: |
34-
# When the environment is up, metaflow-dev shell will wait for readiness
35-
# and then drop into a shell. We feed commands via a heredoc:
3633
cat <<EOF | metaflow-dev shell
3734
echo "Environment is ready; running flow now..."
3835
python metaflow/tutorials/00-helloworld/helloworld.py --environment=pypi run --with kubernetes --with card
3936
EOF
4037
38+
- name: Dump tilt state on failure
39+
if: failure()
40+
run: |
41+
echo "=== Tilt resource status ==="
42+
tilt get uiresources -o wide 2>/dev/null || true
43+
echo "=== Recent tilt logs (last 50 lines) ==="
44+
tail -50 /tmp/tilt.log 2>/dev/null || true
45+
4146
- name: Tear down environment
47+
if: always()
4248
run: |
4349
metaflow-dev down

0 commit comments

Comments
 (0)