Commit 3173ddf
committed
Add retry logic to TestFlyDeployHAPlacement for Corrosion replication lag
The TestFlyDeployHAPlacement test was failing intermittently with:
Error: error creating a new machine: failed to launch VM: internal:
failed to get app: sql: no rows in result set
This is a known Corrosion replication lag issue where the app record hasn't
replicated to all backend hosts yet when creating the second machine for HA.
Changes:
- Split launch and deploy to give more time between app creation and machine provisioning
- Add retry logic using require.EventuallyWithT to retry deploy on replication errors
- Only retry on the specific 'sql: no rows in result set' error
- Fail fast on any other errors to avoid masking real issues
- Retry for up to 30 seconds with 5-second intervals
This makes the test resilient to backend replication lag without changing
backend behavior or risking side effects from longer timeouts.1 parent 5634020 commit 3173ddf
1 file changed
+19
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
84 | 84 | | |
85 | 85 | | |
86 | 86 | | |
| 87 | + | |
87 | 88 | | |
88 | | - | |
| 89 | + | |
89 | 90 | | |
90 | 91 | | |
91 | | - | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
92 | 109 | | |
93 | 110 | | |
94 | 111 | | |
| |||
0 commit comments