Skip to content

Investigate Failure Parsing Traces for Linux Crossgen Scenarios #2228

Open
@Tohron

Description

@Tohron

The run https://dev.azure.com/dnceng/internal/_build/results?buildId=1575975&view=logs&j=0f1e91d4-a224-5187-341a-ffb56e826391&t=071ce499-e2bc-5666-1ddc-8e22e33fe7db&l=28 has a failure for the Linux crossgen_scenarios environment. Multiple workitems involving Crossgen2 fail at the parsing traces step, with the form

[2022/01/27 08:06:41][INFO] Unhandled exception: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
[2022/01/27 08:06:41][INFO]  ---> System.InvalidOperationException: Sequence contains no elements
[2022/01/27 08:06:41][INFO]    at System.Linq.ThrowHelper.ThrowNoElementsException()
[2022/01/27 08:06:41][INFO]    at System.Linq.Enumerable.Max(IEnumerable`1 source)
[2022/01/27 08:06:41][INFO]    at Reporting.Reporter.<>c.<WriteResultTable>b__10_4(Counter c) in /__w/1/s/Payload/performance/src/tools/Reporting/Reporting/Reporter.cs:line 122
[2022/01/27 08:06:41][INFO]    at System.Linq.Enumerable.Max[TSource](IEnumerable`1 source, Func`2 selector)
[2022/01/27 08:06:41][INFO]    at Reporting.Reporter.WriteResultTable() in /__w/1/s/Payload/performance/src/tools/Reporting/Reporting/Reporter.cs:line 122
[2022/01/27 08:06:41][INFO]    at ScenarioMeasurement.Startup.CreateTestReport(String scenarioName, IEnumerable`1 counters, String reportJsonPath, Logger logger) in /__w/1/s/Payload/performance/src/tools/ScenarioMeasurement/Startup/Startup.cs:line 535
[2022/01/27 08:06:41][INFO]    at ScenarioMeasurement.Startup.Main(String appExe, MetricType metricType, String scenarioName, String traceName, Boolean processWillExit, Int32 iterations, String iterationSetup, String setupArgs, String iterationCleanup, String cleanupArgs, Int32 timeout, Int32 measurementDelay, String appArgs, String logFileName, String workingDir, Boolean warmup, Boolean guiApp, Boolean skipProfileIteration, String reportJsonPath, String traceDirectory, String environmentVariables, String innerLoopCommand, String innerLoopCommandArgs, Boolean runWithoutExit, Int32 hotReloadIters, Boolean skipMeasurementIteration, Boolean parseOnly) in /__w/1/s/Payload/performance/src/tools/ScenarioMeasurement/Startup/Startup.cs:line 338
[2022/01/27 08:06:41][INFO]    --- End of inner exception stack trace ---
[2022/01/27 08:06:41][INFO]    at System.RuntimeMethodHandle.InvokeMethod(Object target, Span`1& arguments, Signature sig, Boolean constructor, Boolean wrapExceptions)
[2022/01/27 08:06:41][INFO]    at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
[2022/01/27 08:06:41][INFO]    at System.Reflection.MethodBase.Invoke(Object obj, Object[] parameters)
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Invocation.ModelBindingCommandHandler.InvokeAsync(InvocationContext context)
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_0.<<BuildInvocationChain>b__0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseParseErrorReporting>b__19_0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass14_0.<<UseHelp>b__0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass22_0.<<UseVersionOption>b__0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass21_0.<<UseTypoCorrections>b__0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseSuggestDirective>b__20_0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseParseDirective>b__18_0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseDebugDirective>b__10_0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<RegisterWithDotnetSuggest>b__9_0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass5_0.<<ConfigureConsole>b__0>d.MoveNext()
[2022/01/27 08:06:41][INFO] --- End of stack trace from previous location ---
[2022/01/27 08:06:41][INFO]    at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass12_0.<<UseExceptionHandler>b__0>d.MoveNext()
[2022/01/27 08:06:41][ERROR] Process exited with status 1
[2022/01/27 08:06:41][INFO] Run failure registered


An attempt to reproduce the issue on Perftiger 201 (which ran the Crossgen2 Composite Framework R2R workitem in the linked pipeline) resulted in the scenario run finishing successfully, so this problem appears to be somewhat flaky.

Metadata

Metadata

Assignees

No one assigned

    Labels

    WRIIssues and PR's that may be especially useful to WRI or should be viewed during WRIbugSomething isn't workinglab-infrastructure

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions