Flaky Test List

[dozyio]

List of flaky CI tests to review

  1) WebRTC transport interface compliance
       interface-transport
         should handle many small writes:
     StreamResetError: The stream has been reset
      at WebRTCStream.onRemoteReset (file:///Users/runner/work/js-libp2p/js-libp2p/packages/utils/src/abstract-message-stream.ts:351:17)
      at WebRTCStream.processIncomingProtobuf (file:///Users/runner/work/js-libp2p/js-libp2p/packages/transport-webrtc/src/stream.ts:264:14)
      at file:///Users/runner/work/js-libp2p/js-libp2p/packages/transport-webrtc/src/stream.ts:95:14

  1) webrtc private-to-private
       should dial WebRTC with existing relayed connection:
     TimeoutError: The operation was aborted due to timeout
      at new DOMException (node:internal/per_context/domexception:76:18)
      at Timeout._onTimeout (node:internal/abort_controller:154:9)
      at listOnTimeout (node:internal/timers:605:17)
      at processTimers (node:internal/timers:541:7)

[tabcat]

in firefox and firefox-worker

  1) WebRTC transport interface compliance
       interface-transport
         should handle one big write:
     the event {"isTrusted":false,"error":{"name":"StreamResetError"},"local":false} was thrown, throw an Error :)

[dozyio]

+1

[dozyio]

test-interop

ed25519/tls/yamux echo
       "before all" hook for "go sender to js listener":
     Error: Timeout of 20000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/js-libp2p/js-libp2p/packages/integration-tests/dist/test/interop.js)
      at listOnTimeout (node:internal/timers:605:17)
      at processTimers (node:internal/timers:541:7)

[dozyio]

test-node (macos-latest, lts/*)

WebRTC transport interface compliance
       interface-transport
         should close all streams when the connection closes:
     TimeoutError: The operation was aborted due to timeout
      at new DOMException (node:internal/per_context/domexception:76:18)
      at Timeout._onTimeout (node:internal/abort_controller:154:9)
      at listOnTimeout (node:internal/timers:605:17)
      at processTimers (node:internal/timers:541:7)

[dozyio]

interop

rsa/noise/mplex echo
       "before all" hook for "go sender to go listener":
     Error: Timeout of 20000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/js-libp2p/js-libp2p/packages/integration-tests/dist/test/interop.js)
      at listOnTimeout (node:internal/timers:605:17)
      at processTimers (node:internal/timers:541:7)

[dozyio]

+1

[dozyio]

 1) rsa/noise/mplex echo
       "before all" hook for "js sender to go listener":
     Error: Timeout of 20000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/js-libp2p/js-libp2p/packages/integration-tests/dist/test/interop.js)
      at listOnTimeout (node:internal/timers:605:17)
      at processTimers (node:internal/timers:541:7)

[dozyio]

interop

rsa/noise/yamux echo
       "before all" hook for "js sender to go listener":
     Error: Timeout of 20000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/js-libp2p/js-libp2p/packages/integration-tests/dist/test/interop.js)
      at listOnTimeout (node:internal/timers:605:17)
      at processTimers (node:internal/timers:541:7)

[dozyio]

interop

rsa/plaintext/yamux echo
       "before all" hook for "js sender to go listener":
     Error: Timeout of 20000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/js-libp2p/js-libp2p/packages/integration-tests/dist/test/interop.js)
      at listOnTimeout (node:internal/timers:605:17)
      at processTimers (node:internal/timers:541:7)

[dozyio]

WebRTC-Direct interface-transport compliance
transport events
15:29:05 WARN UDP socket binding failed on port 37783, errno=98
15:29:05 ERROR UDP socket opening failed
15:29:05 FATAL UDP socket creation failed
15:29:05 FATAL Registry initialization failed

[dozyio]

errno=98 is port already in use

[tabcat]

wonder whats happening there.

[dozyio]

firefox

  1) WebRTC transport interface compliance
       interface-transport
         should handle one big write:
     the event {"isTrusted":false,"error":{"name":"StreamResetError"},"local":false} was thrown, throw an Error :)
  thrown2Error@http://127.0.0.1:34629/bundle-out.js:15586:16
  done2@http://127.0.0.1:34629/bundle-out.js:14189:13
  promise callback*callFn@http://127.0.0.1:34629/bundle-out.js:14235:20
  next@http://127.0.0.1:34629/bundle-out.js:15205:20
  next@http://127.0.0.1:34629/bundle-out.js:15121:20
  timeslice@http://127.0.0.1:34629/bundle-out.js:18300:33
  next@http://127.0.0.1:34629/bundle-out.js:15207:17
  next@http://127.0.0.1:34629/bundle-out.js:15121:20
  cbHookRun@http://127.0.0.1:34629/bundle-out.js:15177:17
  done2@http://127.0.0.1:34629/bundle-out.js:14189:13
  promise callback*callFn@http://127.0.0.1:34629/bundle-out.js:14235:20
  next@http://127.0.0.1:34629/bundle-out.js:15139:17
  timeslice@http://127.0.0.1:34629/bundle-out.js:18300:33
  next@http://127.0.0.1:34629/bundle-out.js:15207:17
  done2@http://127.0.0.1:34629/bundle-out.js:14189:13
  promise callback*callFn@http://127.0.0.1:34629/bundle-out.js:14235:20
  next@http://127.0.0.1:34629/bundle-out.js:15205:20
  next@http://127.0.0.1:34629/bundle-out.js:15121:20
  timeslice@http://127.0.0.1:34629/bundle-out.js:18300:33

[tabcat]

this is common one

[dozyio]

ran 150 tests locally with new playwright for this test - passed every time... old playwright failed ~1 in 20

[dozyio]

electron

  instantiate the transport
    ✔ create

  listen
    ip4
      1) listen, check for promise


  1 passing (37ms)
  1 failing

  1) listen
       ip4
         listen, check for promise:
     Error: listen EADDRINUSE: address already in use 127.0.0.1:47382
      at Server.setupListenHandle [as _listen2] (node:net:1940:16)
      at listenInCluster (node:net:1997:12)
      at node:net:2206:7
      at process.processTicksAndRejections (node:internal/process/task_queues:90:21)

[dozyio]

 1) WebRTC transport interface compliance
      interface-transport
        should handle many small writes:
    Timeout of 360000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves.
 createTimeoutError$1@http://127.0.0.1:39525/bundle-out.js:13998:21
 callFn@http://127.0.0.1:39525/bundle-out.js:14234:19
 next@http://127.0.0.1:39525/bundle-out.js:15205:20
 next@http://127.0.0.1:39525/bundle-out.js:15121:20
 timeslice@http://127.0.0.1:39525/bundle-out.js:18300:33
 next@http://127.0.0.1:39525/bundle-out.js:15207:17
 next@http://127.0.0.1:39525/bundle-out.js:15121:20
 cbHookRun@http://127.0.0.1:39525/bundle-out.js:15177:17
 done2@http://127.0.0.1:39525/bundle-out.js:14189:13
 promise callback*callFn@http://127.0.0.1:39525/bundle-out.js:14235:20
 next@http://127.0.0.1:39525/bundle-out.js:15139:17
 timeslice@http://127.0.0.1:39525/bundle-out.js:18300:33
 next@http://127.0.0.1:39525/bundle-out.js:15207:17
 done2@http://127.0.0.1:39525/bundle-out.js:14189:13
 promise callback*callFn@http://127.0.0.1:39525/bundle-out.js:14235:20
 next@http://127.0.0.1:39525/bundle-out.js:15205:20
 next@http://127.0.0.1:39525/bundle-out.js:15121:20
 timeslice@http://127.0.0.1:39525/bundle-out.js:18300:33
 next@http://127.0.0.1:39525/bundle-out.js:15207:17
 next@http://127.0.0.1:39525/bundle-out.js:15121:20
 cbHookRun@http://127.0.0.1:39525/bundle-out.js:15177:17
 done2@http://127.0.0.1:39525/bundle-out.js:14189:13
 promise callback*callFn@http://127.0.0.1:39525/bundle-out.js:14235:20
 next@http://127.0.0.1:39525/bundle-out.js:15139:17
 timeslice@http://127.0.0.1:39525/bundle-out.js:18300:33
 next@http://127.0.0.1:39525/bundle-out.js:15207:17
 done2@http://127.0.0.1:39525/bundle-out.js:14189:13
 promise callback*callFn@http://127.0.0.1:39525/bundle-out.js:14235:20
 next@http://127.0.0.1:39525/bundle-out.js:15205:20
 next@http://127.0.0.1:39525/bundle-out.js:15121:20
 timeslice@http://127.0.0.1:39525/bundle-out.js:18300:33