[darwin] Flaky test on Darwin framework tests - asan (testSubscriptionPool/testSubscriptionPoolManyDevices?)

[andy31415]

See https://github.com/project-chip/connectedhomeip/actions/runs/14918836865/job/41910740444

2025-05-09T01:37:28.3414350Z Failing tests:
2025-05-09T01:37:28.3414780Z 
2025-05-09T01:37:28.3429690Z Test session results, code coverage, and logs:
2025-05-09T01:37:28.3433230Z 	/tmp/darwin/framework-tests/TestResults.xcresult
2025-05-09T01:37:28.3435450Z 
2025-05-09T01:37:28.3441460Z 	-[MTRPerControllerStorageTests testSubscriptionPool]
2025-05-09T01:37:28.3445330Z 	-[MTRPerControllerStorageTests testSubscriptionPoolManyDevices]

It is unclear which one fails - is it subscription pool?

[bzbarsky-apple]

The primary failure here is in testSubscriptionPool:

2025-05-09T01:35:57.6032960Z /Users/runner/work/connectedhomeip/connectedhomeip/src/darwin/Framework/CHIPTests/MTRPerControllerStorageTests.m:2902: error: -[MTRPerControllerStorageTests testSubscriptionPool] : Asynchronous wait failed: Exceeded timeout of 3 seconds, with unfulfilled expectations: "Fake device deleted".

and in fact, the dealloc of the MTRDevice does not happen until after this:

2025-05-09T01:35:57.7019210Z 2025-05-09 01:35:57.581129+0000 xctest[45811:128193] [Default] MTRDevice dealloc: 0x615000601600

Need to figure out why it did not get deallocated....

[bzbarsky-apple]

Ah, as @jtung-apple points out the test runner lost timeslice for 13s or so here:

2025-05-09T01:35:44.6114660Z 2025-05-09 01:35:44.539364+0000 xctest[45811:128193] [Default] MTRAsyncWorkQueue<<MTRDeviceController_Concrete: 0x61b0000f5e80, uuid: A6422A87-FCD6-43F9-B798-C69AE84F6C38, suspended: NO>> executing work item [4271]

is when we started the 3-second wait, and we did not detect it ending until 13 seconds later (!). And the dealloc happened as soon as we got scheduled on the CPU again, but again more than 3s later.

We could just make this wait much longer, but let's see whether this ever happens again first.

[andy31415]

https://github.com/project-chip/connectedhomeip/actions/runs/14997823743/job/42138264912 also says:

2025-05-13T14:25:47.8599670Z Test session results, code coverage, and logs:
2025-05-13T14:25:47.8600430Z 	/tmp/darwin/framework-tests/TestResults.xcresult
2025-05-13T14:25:47.8600930Z 
2025-05-13T14:25:47.8603010Z Failing tests:
2025-05-13T14:25:47.8652320Z 	-[MTRPerControllerStorageTests testSubscriptionPoolManyDevices]

[andy31415]

also in

https://github.com/project-chip/connectedhomeip/actions/runs/14983442980/job/42094517213?pr=38525

2025-05-12T23:39:44.9272090Z 	-[MTRPerControllerStorageTests testSubscriptionPoolManyDevices]

I will create a PR to disable this test, this has high flake rates.

[bzbarsky-apple]

Should have been fixed in #38854