Skip to content

Fix Flaky Submit Test#1011

Merged
abhinav merged 2 commits intoabhinav:mainfrom
irl-llc:gs/fix-flaky-submit-test
Feb 3, 2026
Merged

Fix Flaky Submit Test#1011
abhinav merged 2 commits intoabhinav:mainfrom
irl-llc:gs/fix-flaky-submit-test

Conversation

@ed-irl
Copy link
Contributor

@ed-irl ed-irl commented Feb 3, 2026

This fixes a flaky test assertion that relies on strict string comparison. The root cause is a warning that prints during template listing.

Replace cmpenv stderr golden file comparison with individual
stderr assertions. The exact comparison was flaky because
a "Failed to cache templates" warning could non-deterministically
appear in stderr when the template caching timeout fires.

Individual stderr assertions match the pattern used by
stack_submit.txt and are tolerant of extra log lines.
@abhinav abhinav enabled auto-merge (squash) February 3, 2026 22:27
@abhinav
Copy link
Owner

abhinav commented Feb 3, 2026

Thanks!

@abhinav abhinav merged commit 83d18b5 into abhinav:main Feb 3, 2026
21 of 22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants