[NativeAOT-iOS] MacCatalyst fails to start/log `nativeaot.SmokeTests` tests

[matouskozak]

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=804204
Build error leg or test failing:

• nativeaot.SmokeTests.Reflection,
• nativeaot.SmokeTests.StackTraceMetadata
• nativeaot.SmokeTests.Preinitialization

Affected CI: maccatalyst-arm64 Release AllSubsets_NativeAOT_RuntimeTests (runtime-extra-platforms)

The test are failing either with:
XHarness exit code: 83 (APP_LAUNCH_FAILURE)

[05:10:37.6845280] The application cannot be opened for an unexpected reason, error=Error Domain=NSOSStatusErrorDomain Code=-600 "procNotFound: no eligible process with specified descriptor" UserInfo={_LSLine=387, _LSFunction=_LSAnnotateAndSendAppleEventWithOptions}

or
XHarness exit code: 82 (RETURN_CODE_NOT_SET)

Failed to detect application's exit code. The log file was empty / not found at /tmp/helix/working/9D2308EA/w/9FFA08F1/uploads/Reports/nativeaot.SmokeTests.Reflection/Reflection/net.dot.nativeaot_SmokeTests_Reflection.log

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorPattern": "nativeaot/SmokeTests/.+\\[FAIL\\]",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=804204
Error message validated: [nativeaot/SmokeTests/.+\[FAIL\]]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 9/12/2024 10:07:58 AM UTC

Report

Build	Definition	Test	Pull Request
1042908	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1039623	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1038074	dotnet/runtime	nativeaot.SmokeTests.TrimmingBehaviors.WorkItemExecution
1036170	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1034997	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1027363	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1027038	dotnet/runtime	nativeaot.SmokeTests.TrimmingBehaviors.WorkItemExecution
1026668	dotnet/runtime	nativeaot/SmokeTests/Preinitialization/Preinitialization/Preinitialization.sh
1025865	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh
1026094	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh
1025960	dotnet/runtime	nativeaot.SmokeTests.UnitTests.WorkItemExecution
1025626	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1025615	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh
1025445	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh	#114862
1025187	dotnet/runtime	nativeaot/SmokeTests/Preinitialization/Preinitialization/Preinitialization.sh
1024678	dotnet/runtime	nativeaot/SmokeTests/StackTraceMetadata/StackTraceMetadata/StackTraceMetadata.sh
1024622	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh	#114862
1024193	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1023896	dotnet/runtime	nativeaot/SmokeTests/Preinitialization/Preinitialization/Preinitialization.sh
1023328	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh
1023267	dotnet/runtime	nativeaot/SmokeTests/StackTraceMetadata/StackTraceMetadata/StackTraceMetadata.sh	#114862
1023185	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh	#114148
1023237	dotnet/runtime	nativeaot.SmokeTests.TrimmingBehaviors.WorkItemExecution
1022831	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh	#114862
1022657	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1022038	dotnet/runtime	nativeaot/SmokeTests/DynamicGenerics/DynamicGenerics/DynamicGenerics.sh	#114862
1021722	dotnet/runtime	nativeaot/SmokeTests/Reflection/Reflection/Reflection.sh
1021425	dotnet/runtime	nativeaot/SmokeTests/UnitTests/UnitTests/UnitTests.sh
1021239	dotnet/runtime	nativeaot/SmokeTests/UnitTests/UnitTests/UnitTests.sh
1021153	dotnet/runtime	nativeaot/SmokeTests/DynamicGenerics/DynamicGenerics/DynamicGenerics.sh
1021008	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	2	31

[dotnet-policy-service]

Tagging subscribers to 'os-maccatalyst': @vitek-karas, @kotlarmilos, @ivanpovazan, @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service]

Tagging subscribers to this area: @directhex, @matouskozak
See info in area-owners.md if you want to be subscribed.

[matouskozak]

Could it be related to #102882 @ivanpovazan @kotlarmilos ?

[ivanpovazan]

Could it be related to #102882 @ivanpovazan @kotlarmilos ?

I don't think so, that issue did disable the test, but we had a failure with it on tvos-arm64 even before in:
#90460

If I remember correctly the behavior was similar to what you are getting ie the device log showed correct output in the logs but test return value was not what the test runner expected.

I would check if we are properly rooting every possible test infra assembly when we build these tests with NativeAOT.

[ivanpovazan]

@matouskozak @kotlarmilos could you check this:

I would check if we are properly rooting every possible test infra assembly when we build these tests with NativeAOT.