Commit ba93745
committed
Merge #6631: test: set default delay to 0.05s for wait_until in functional tests
0d9418e test: reduce delay in wait_until from 0.5s to 0.05s (Konstantin Akimov)
876d6c8 test: enforce 1 second delay for wait_for_sporks helper (Konstantin Akimov)
ec6e7bf test: enforce 1s delay for feature_mnehf test (Konstantin Akimov)
6ab3f7c test: reduce spamming quorum list to logs while waiting (Konstantin Akimov)
9d9975f test: simplify wait_for_quorum_list (Konstantin Akimov)
Pull request description:
## Issue being fixed or feature implemented
Waiting for 0.5s in functional test for every action is a bit excessive, especially for p2p tests that sending messages by localnetwork and waiting at least 0.5 seconds before checking if message is received.
## What was done?
Decreasing default delay from 0.5s to 0.05s. It affects mostly p2p tests, but many other tests become faster too.
For quorum formation; for sporks and some other dash specific features bigger delays (0.5s, 1s) are used.
Further improvements are blocked by #6673, #6672, #6671 and are out of scope this PR.
## How Has This Been Tested?
Speed up on CI for 30% and more.
[develop] linux64-test https://gitlab.com/dashpay/dash/-/jobs/10049432489
ALL | ✓ Passed | 7241 s (accumulated)
Runtime: 1272 s
[PR] linux64-test https://gitlab.com/dashpay/dash/-/jobs/10067158169
ALL | ✓ Passed | 5421 s (accumulated)
Runtime: 938 s
**-25%**
[develop] linux64-nowallet https://gitlab.com/dashpay/dash/-/jobs/10049432511
ALL | ✓ Passed | 2739 s (accumulated)
Runtime: 488 s
[PR] linux64-nowallet https://gitlab.com/dashpay/dash/-/jobs/10067158174
ALL | ✓ Passed | 1232 s (accumulated)
Runtime: 243 s
**-49%**
[develop] linux64-tsan https://gitlab.com/dashpay/dash/-/jobs/10049432499
ALL | ✓ Passed | 10399 s (accumulated)
Runtime: 2023 s
[PR] linux64-tsan https://gitlab.com/dashpay/dash/-/jobs/10072993489
ALL | ✓ Passed | 8710 s (accumulated)
Runtime: 1543 s
**-25%**
[develop] Functional tests on localhost (-O3, debug, no sanitizers, -j20):
ALL | ✓ Passed | 6680 s (accumulated)
Runtime: 372 s
[PR] Functional tests on localhost (-O3, debug, no sanitizers, -j20):
ALL | ✓ Passed | 4609 s (accumulated)
Runtime: 365 s
**Benefits of running locally in 20 parallel jobs are very slight. Accumulated time is decreased for 32% as expected, but total time is improved less than 2%.**
It is because the slowest tests requires many quorums to be formed and they are still slow.
## Breaking Changes
N/A
## Checklist:
- [x] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have added or updated relevant unit/integration/functional/e2e tests
- [ ] I have made corresponding changes to the documentation
- [x] I have assigned this pull request to a milestone
ACKs for top commit:
PastaPastaPasta:
utACK 0d9418e; hopefully it doesn't make tests flakey
UdjinM6:
utACK 0d9418e
Tree-SHA512: 32405bd1f229af5146c96aea6031cee3f084d3ebfb3ec515ad743e79c3bc29a5c891d4330688d07b63b0e06ef7cd50240ab8b6d1a3939a56fe3e64a55918edd1File tree
3 files changed
+13
-21
lines changed- test/functional
- test_framework
3 files changed
+13
-21
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
229 | 229 | | |
230 | 230 | | |
231 | 231 | | |
232 | | - | |
| 232 | + | |
233 | 233 | | |
234 | 234 | | |
235 | 235 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
896 | 896 | | |
897 | 897 | | |
898 | 898 | | |
899 | | - | |
| 899 | + | |
900 | 900 | | |
901 | 901 | | |
902 | 902 | | |
| |||
1969 | 1969 | | |
1970 | 1970 | | |
1971 | 1971 | | |
1972 | | - | |
| 1972 | + | |
1973 | 1973 | | |
1974 | 1974 | | |
1975 | 1975 | | |
| |||
2091 | 2091 | | |
2092 | 2092 | | |
2093 | 2093 | | |
2094 | | - | |
| 2094 | + | |
2095 | 2095 | | |
2096 | | - | |
2097 | | - | |
2098 | | - | |
2099 | | - | |
2100 | | - | |
2101 | | - | |
2102 | | - | |
| 2096 | + | |
| 2097 | + | |
| 2098 | + | |
2103 | 2099 | | |
2104 | | - | |
| 2100 | + | |
2105 | 2101 | | |
2106 | | - | |
2107 | | - | |
2108 | | - | |
2109 | | - | |
2110 | | - | |
2111 | | - | |
2112 | | - | |
2113 | | - | |
| 2102 | + | |
| 2103 | + | |
| 2104 | + | |
| 2105 | + | |
2114 | 2106 | | |
2115 | 2107 | | |
2116 | 2108 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
247 | 247 | | |
248 | 248 | | |
249 | 249 | | |
250 | | - | |
| 250 | + | |
251 | 251 | | |
252 | 252 | | |
253 | 253 | | |
| |||
0 commit comments