Closed
Description
System.Net.Security test suite is rather often killed on Mono - Linux (mostly RedHat 7 and SLES 12)
- High frequency -- failure ~1/day
Data from 7/8-8/23 (incl. PRs) ... with console logs verified:
| Day | Run | OS |
|---|---|---|
| 7/14 | Official run | SLES.12.Amd64.Open |
| 7/15 | PR #55724 | RedHat.7.Amd64.Open |
| 7/18 | Official run | RedHat.7.Amd64.Open |
| 7/19 | Official run | SLES.12.Amd64.Open |
| 7/19 | Official run | SLES.12.Amd64.Open |
| 7/21 | PR #55664 | RedHat.7.Amd64.Open |
| 7/23 | PR #56196 | RedHat.7.Amd64.Open |
| 7/24 | PR #56211 | RedHat.7.Amd64.Open |
| 7/27 | PR #56380 | RedHat.7.Amd64.Open |
| 7/28 | PR #56466 | RedHat.7.Amd64.Open |
| 7/28 | Official run | SLES.12.Amd64.Open |
| 7/29 | PR #56534 | RedHat.7.Amd64.Open |
| 8/5 | PR #56538 | RedHat.7.Amd64.Open |
| 8/5 | PR #56568 | RedHat.7.Amd64.Open |
| 8/8 | PR #57036 | RedHat.7.Amd64.Open |
| 8/9 | PR #57005 | RedHat.7.Amd64.Open |
| 8/9 | PR #55362 | RedHat.7.Amd64.Open |
| 8/11 | Official run | SLES.12.Amd64.Open |
| 8/11 | Official run | SLES.12.Amd64.Open (not a duplicate of above) |
| 8/13 | PR #57210 | RedHat.7.Amd64.Open |
| 8/14 | PR #57329 | RedHat.7.Amd64.Open |
| 8/14 | Official run | RedHat.7.Amd64.Open |
| 8/15 | PR #57432 | RedHat.7.Amd64.Open |
| 8/15 | Official run | SLES.12.Amd64.Open |
| 8/16 | PR #57501 | RedHat.7.Amd64.Open |
| 8/18 | PR #57678 | RedHat.7.Amd64.Open |
| 8/23 | Official run | SLES.12.Amd64.Open |
| 8/24 | Official run - release/6.0 | RedHat.7.Amd64.Open |
| 8/26 | PR #57996 | RedHat.7.Amd64.Open |
| 8/30 | Official run - main=7.0 | SLES.12.Amd64.Open |
| 8/31 | Official run - release/6.0 | SLES.12.Amd64.Open |
Data from 3/29-7/8 (incl. PRs) -- without console log verification (the logs are not available anymore):
- Looks like regression introduced on 4/26
| Day | Run | OS |
|---|---|---|
| 4/26 | PR #51853 | RedHat.7.Amd64.Open |
| 4/26 | PR #51620 | RedHat.7.Amd64.Open |
| 4/27 | PR #51869 | RedHat.7.Amd64.Open |
| 4/28 | PR #51976 | RedHat.7.Amd64.Open |
| 4/29 | Official run | SLES.12.Amd64.Open |
| 5/1 | PR #50815 | RedHat.7.Amd64.Open |
| 5/3 | PR #52202 | RedHat.7.Amd64.Open |
| 5/4 | PR #52147 | RedHat.7.Amd64.Open |
| 5/4 | PR #52235 | RedHat.7.Amd64.Open |
| 5/4 | Official run | SLES.12.Amd64.Open |
| 5/5 | PR #52266 | RedHat.7.Amd64.Open |
| 5/6 | PR #52344 | RedHat.7.Amd64.Open |
| 5/7 | PR #52229 | RedHat.7.Amd64.Open |
| 5/7 | PR #52373 | RedHat.7.Amd64.Open |
| 5/7 | PR #52246 | RedHat.7.Amd64.Open |
| 5/8 | Official run | SLES.12.Amd64.Open |
| 5/8 | PR #52212 | RedHat.7.Amd64.Open |
| 5/11 | Official run | SLES.12.Amd64.Open |
| 5/12 | PR #52433 | RedHat.7.Amd64.Open |
| 5/13 | PR #52691 | RedHat.7.Amd64.Open |
| 5/14 | PR #52777 | RedHat.7.Amd64.Open |
| 5/15 | PR #52812 | RedHat.7.Amd64.Open |
| 5/17 | PR #52140 | RedHat.7.Amd64.Open |
| 5/17 | Official run | SLES.12.Amd64.Open |
| 5/18 | Official run | SLES.12.Amd64.Open |
| 5/19 | Official run | Alpine.312.Amd64.Open |
| 5/20 | PR #53044 | RedHat.7.Amd64.Open |
| 5/21 | PR #50337 | RedHat.7.Amd64.Open |
| 5/24 | PR #53180 | RedHat.7.Amd64.Open |
| 5/25 | PR #53225 | RedHat.7.Amd64.Open |
| 5/26 | Official run | Alpine.312.Amd64.Open |
| 5/26 | PR #51953 | RedHat.7.Amd64.Open |
| 5/27 | PR #53340 | RedHat.7.Amd64.Open |
| 5/27 | PR #43954 | RedHat.7.Amd64.Open |
| 5/28 | PR #53392 | RedHat.7.Amd64.Open |
| 5/30 | PR #53450 | RedHat.7.Amd64.Open |
| 6/1 | PR #48487 | RedHat.7.Amd64.Open |
| 6/1 | PR #51665 | RedHat.7.Amd64.Open |
| 6/3 | PR #53652 | RedHat.7.Amd64.Open |
| 6/4 | PR #53716 | RedHat.7.Amd64.Open |
| 6/8 | PR #48725 | RedHat.7.Amd64.Open |
| 6/8 | PR #53669 | RedHat.7.Amd64.Open |
| 6/9 | PR #52923 | Alpine.312.Amd64.Open |
| 6/9 | PR #53866 | RedHat.7.Amd64.Open |
| 6/9 | Official run | Debian.9.Amd64.Open |
| 6/10 | PR #53968 | RedHat.7.Amd64.Open |
| 6/11 | PR #53704 | RedHat.7.Amd64.Open |
| 6/11 | PR #53882 | RedHat.7.Amd64.Open |
| 6/11 | PR #54024 | RedHat.7.Amd64.Open |
| 6/14 | Official run | SLES.12.Amd64.Open |
| 6/15 | PR #53201 | RedHat.7.Amd64.Open |
| 6/15 | PR #54098 | RedHat.7.Amd64.Open |
| 6/17 | PR #54246 | RedHat.7.Amd64.Open |
| 6/17 | PR #54289 | Alpine.312.Amd64.Open |
| 6/17 | PR #54127 | RedHat.7.Amd64.Open |
| 6/17 | Official run | RedHat.7.Amd64.Open |
| 6/18 | PR #47640 | RedHat.7.Amd64.Open |
| 6/21 | Official run | SLES.12.Amd64.Open |
| 6/21 | PR #54186 | RedHat.7.Amd64.Open |
| 6/22 | Official run | SLES.12.Amd64.Open |
| 6/23 | PR #54253 | RedHat.7.Amd64.Open |
| 6/24 | PR #53603 | RedHat.7.Amd64.Open |
| 6/25 | PR #54685 | RedHat.7.Amd64.Open |
| 6/26 | PR #54656 | RedHat.7.Amd64.Open |
| 6/26 | PR #54246 | RedHat.7.Amd64.Open |
| 6/26 | Official run | SLES.12.Amd64.Open |
| 6/28 | Official run | SLES.12.Amd64.Open |
| 6/28 | Official run | SLES.12.Amd64.Open |
| 6/30 | PR #54254 | RedHat.7.Amd64.Open |
| 6/30 | Official run | RedHat.7.Amd64.Open |
| 6/30 | PR #54812 | RedHat.7.Amd64.Open |
| 6/30 | PR #54959 | RedHat.7.Amd64.Open |
| 7/1 | PR #54136 | RedHat.7.Amd64.Open |
| 7/1 | PR #54625 | RedHat.7.Amd64.Open |
| 7/1 | PR #55012 | RedHat.7.Amd64.Open |
| 7/2 | PR #55076 | RedHat.7.Amd64.Open |
| 7/6 | PR #55188 | RedHat.7.Amd64.Open |
| 7/7 | PR #55258 | RedHat.7.Amd64.Open |
| 7/7 | PR #55266 | RedHat.7.Amd64.Open |
| 7/7 | Official run | SLES.12.Amd64.Open |
| 7/8 | Official run | SLES.12.Amd64.Open |
Example of log from 7/27:
Console log: 'System.Net.Security.Tests' from job ae572e88-45ac-4fe9-aaf0-b4dc6e8d9c57 workitem c9a39349-9953-4d79-8314-b7bf004c82ad (redhat.7.amd64.open.rt) executed on machine a000FA9
+ ./RunTests.sh --runtime-path /mnt/work/BBD00A47/p
----- start Tue Jul 27 14:43:07 UTC 2021 =============== To repro directly: =====================================================
pushd .
/mnt/work/BBD00A47/p/dotnet exec --runtimeconfig System.Net.Security.Tests.runtimeconfig.json --depsfile System.Net.Security.Tests.deps.json xunit.console.dll System.Net.Security.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing
popd
===========================================================================================================
/mnt/work/BBD00A47/w/A01A08F7/e /mnt/work/BBD00A47/w/A01A08F7/e
Discovering: System.Net.Security.Tests (method display = ClassAndMethod, method display options = None)
Discovered: System.Net.Security.Tests (found 286 of 472 test cases)
Starting: System.Net.Security.Tests (parallel test collections = on, max threads = 2)
System.Net.Security.Tests.SslStreamEKUTest.SslStream_SelfSignedClientEKUClientAuth_Ok [SKIP]
Condition(s) not met: "IsRootCertificateInstalled"
System.Net.Security.Tests.SslStreamEKUTest.SslStream_ServerEKUClientAuth_Fails [SKIP]
Condition(s) not met: "IsRootCertificateInstalled"
System.Net.Security.Tests.SslStreamEKUTest.SslStream_ClientEKUServerAuth_Fails [SKIP]
Condition(s) not met: "IsRootCertificateInstalled"
System.Net.Security.Tests.SslStreamEKUTest.SslStream_NoEKUServerAuth_Ok [SKIP]
Condition(s) not met: "IsRootCertificateInstalled"
System.Net.Security.Tests.SslStreamEKUTest.SslStream_NoEKUClientAuth_Ok [SKIP]
Condition(s) not met: "IsRootCertificateInstalled"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_OnlyTls13CipherSuiteAllowedButChosenProtocolsDoesNotAllowIt_Fails [SKIP]
Condition(s) not met: "CipherSuitesPolicyAndTls13Supported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_OnlyNonTls13CipherSuiteAllowedButOtherSideDoesNotAllowIt_Fails [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowSameTwoOnBothSidesLessPreferredIsTls13_Success [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.NegotiatedCipherSuite_SslProtocolIsTls13_ShouldBeTls13 [SKIP]
Condition(s) not met: "Tls13Supported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowSomeCipherSuitesWithNoEncryptionOption_Fails [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_OnlyNonTls13CipherSuitesAllowedButChosenProtocolDoesNotAllowIt_Fails [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_ThreeCipherSuitesWithTwoOverlapping_Success [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowedCipherSuitesIncludesSubsetOfInput_Success [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowOneOnOneSideTls13_Success [SKIP]
Condition(s) not met: "CipherSuitesPolicyAndTls13Supported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowTwoOnBothSidesWithSingleOverlapNonTls13_Success [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_TwoCipherSuitesWithAllOverlapping_Success [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.Tls13IsSupported_GetValue_ReturnsTrue [SKIP]
Condition(s) not met: "IsKnownPlatformSupportingTls13"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_AllowTwoOnBothSidesWithNoOverlapNonTls13_Fails [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_OnlyTls13CipherSuiteAllowedOtherSideDoesNotAllowTls13_Fails [SKIP]
Condition(s) not met: "CipherSuitesPolicyAndTls13Supported"
System.Net.Security.Tests.NegotiatedCipherSuiteTest.CipherSuitesPolicy_NothingAllowed_Fails [SKIP]
Condition(s) not met: "CipherSuitesPolicySupported"
System.Net.Security.Tests.SslStreamNetworkStreamTest.SslStream_NegotiateClientCertificateAsyncNoRenego_Succeeds [SKIP]
Condition(s) not met: "SupportsRenegotiation"
System.Net.Security.Tests.SslStreamNetworkStreamTest.SslStream_NegotiateClientCertificateAsync_ServerDontDrainClientData [SKIP]
Condition(s) not met: "SupportsRenegotiation"
['System.Net.Security.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]