Test failure: Regressions/coreclr/GitHub_35000/test35000/test35000.cmd

[v-wenyuxu]

Failed in: runtime-coreclr outerloop 20250303.5

Failed tests:

coreclr windows x86 Checked no_tiered_compilation @ Windows.10.Amd64.Open
    - Regressions/coreclr/GitHub_35000/test35000/test35000.cmd
coreclr windows x86 Checked @ Windows.10.Amd64.Open
    - Regressions/coreclr/GitHub_35000/test35000/test35000.cmd

Error message:

 
Return code:      1
Raw output file:      C:hwB7FA09C6wAD8509A9uploadscoreclrGitHub_35000	est35000output.txt
Raw output:
BEGIN EXECUTION
 "C:hwB7FA09C6pcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  test35000.dll 
System.NullReferenceException: Object reference not set to an instance of an object.
   at Test35000.TestEntryPoint()
   at __GeneratedMainWrapper.Main()
Expected: 100
Actual: 101
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:cores since 3/3/2025 7:45:54 PM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> C:hwB7FA09C6wAD8509A9eRegressionsRegressions../coreclr/GitHub_35000/test35000/test35000.cmd

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor55|0_56(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

[v-wenyuxu]

Failed in: runtime-coreclr outerloop 20250304.4

Failed tests:

coreclr windows x86 Checked no_tiered_compilation @ Windows.10.Amd64.Open
    - Regressions/coreclr/GitHub_35000/test35000/test35000.cmd

Error message:

 
Return code:      1
Raw output file:      C:hwA2ED08EEw9C86086BuploadscoreclrGitHub_35000	est35000output.txt
Raw output:
BEGIN EXECUTION
 "C:hwA2ED08EEpcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  test35000.dll 
System.NullReferenceException: Object reference not set to an instance of an object.
   at Test35000.TestEntryPoint()
   at __GeneratedMainWrapper.Main()
Expected: 100
Actual: 101
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:cores since 3/5/2025 3:04:51 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> C:hwA2ED08EEw9C86086BeRegressionsRegressions../coreclr/GitHub_35000/test35000/test35000.cmd

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor55|0_56(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

[ericstj]

Would be nice if we had line info here. I think that means CoreCLR tests are missing symbols? cc @hoyosjs

I pulled the helix payload and ran locally - here's what I see

Here's a dump https://microsoft-my.sharepoint.com/:u:/p/ericstj/EZQCl-QQHKJNkLSw6caTPxAB4axXj2z-xZPPrMDwjdPPFA?e=Svx2hf

So that looks to me like it's either a JIT or runtime problem since the exception is not being caught correctly. @jeffschwMSFT can you please re-triage?

[ericstj]

Correction - the test expects the NRE when it's invoking an instance method without providing the instance. The problem here is that it only null-ref'ed once instead of 10 times. @steveharter could this be related to invoke work?

Expected: 100
Actual: 101

runtime/src/tests/Regressions/coreclr/GitHub_35000/test35000.cs

Line 51 in 28facae

return (nullRefCount == LoopCount) ? 100 : 101;