failure in CreateDefaultBuilder_ConfigJsonDoesReload

[danmoseley]

Built 1d43977 on Windows, ran all tests, this failed

      <test name="Microsoft.Extensions.Hosting.Tests.HostTests.CreateDefaultBuilder_ConfigJsonDoesReload" type="Microsoft.Extensions.Hosting.Tests.HostTests" method="CreateDefaultBuilder_ConfigJsonDoesReload" time="11.237517" result="Fail">
        <failure exception-type="Xunit.Sdk.EqualException">
          <message><![CDATA[Assert.Equal() Failure: Strings differ\r\n                               ↓ (pos 20)\r\nExpected: \"Hello ASP.NET Core: 7796a03e9f744e68b6a97\"···\r\nActual:   \"Hello ASP.NET Core: 26ec8c29bc7042d3b9c86\"···\r\n                               ↑ (pos 20)]]></message>
          <stack-trace><![CDATA[   at Microsoft.Extensions.Hosting.Tests.HostTests.CreateDefaultBuilder_ConfigJsonDoesReload() in C:\git\runtime\src\libraries\Microsoft.Extensions.Hosting\tests\UnitTests\HostTests.cs:line 361
--- End of stack trace from previous location ---]]></stack-trace>
        </failure>
      </test>

It passes when I run it again several times. Perhaps flakiness in file change events ?

Tagging subscribers to this area: @dotnet/area-extensions-hosting
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Built 1d43977 on Windows, ran all tests, this failed

      <test name="Microsoft.Extensions.Hosting.Tests.HostTests.CreateDefaultBuilder_ConfigJsonDoesReload" type="Microsoft.Extensions.Hosting.Tests.HostTests" method="CreateDefaultBuilder_ConfigJsonDoesReload" time="11.237517" result="Fail">
        <failure exception-type="Xunit.Sdk.EqualException">
          <message><![CDATA[Assert.Equal() Failure: Strings differ\r\n                               ↓ (pos 20)\r\nExpected: \"Hello ASP.NET Core: 7796a03e9f744e68b6a97\"···\r\nActual:   \"Hello ASP.NET Core: 26ec8c29bc7042d3b9c86\"···\r\n                               ↑ (pos 20)]]></message>
          <stack-trace><![CDATA[   at Microsoft.Extensions.Hosting.Tests.HostTests.CreateDefaultBuilder_ConfigJsonDoesReload() in C:\git\runtime\src\libraries\Microsoft.Extensions.Hosting\tests\UnitTests\HostTests.cs:line 361
--- End of stack trace from previous location ---]]></stack-trace>
        </failure>
      </test>

It passes when I run it again several times. Perhaps flakiness in file change events ?

Author:	danmoseley
Assignees:	-
Labels:	untriaged, area-Extensions-Hosting
Milestone:	-

[steveharter]

It looks like there is also the CreateDefaultBuilder_ConfigJsonDoesNotReload which modifies the same config, likely running at the same time conflicting. If this is the case, these will either need a separate config or we need to run the tests there serially or use a lock between them for concurrency.

[steveharter]

Testing a fix here by running the tests in a loop is made more difficult by CreateDefaultBuilder_ConfigJsonDoesNotReload since PlatformNotSupportedException is thrown (for EventLog access) from both VS and from a command prompt when running just those tests.