4.x: SchemaAgreementIT.should_agree_when_up_nodes_agree fails on CICD

[dkropachev]

Failure:

[INFO] Running com.datastax.oss.driver.core.metadata.SchemaAgreementIT
02:41:43.436 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, node2, pause, --config-dir=/tmp/ccm3906584837836212904]
02:41:50.871 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, node2, resume, --config-dir=/tmp/ccm3906584837836212904]
02:41:52.430 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, node2, stop, --config-dir=/tmp/ccm3906584837836212904]
02:41:56.873 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, node2, start, --wait-for-binary-proto, --wait-other-notice, --config-dir=/tmp/ccm3906584837836212904]
02:42:00.322 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr> Traceback (most recent call last):
02:42:00.322 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/bin/ccm", line 74, in <module>
02:42:00.322 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     cmd.run()
02:42:00.322 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/cmds/node_cmds.py", line 196, in run
02:42:00.322 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     self.node.start(not self.options.no_join_ring,
02:42:00.322 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 675, in start
02:42:00.322 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     node.watch_log_for_alive(self, from_mark=mark)
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 534, in watch_log_for_alive
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     tofind = [f"({node.address()}|{node.hostid()}).* now UP" for node in tofind]
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 534, in <listcomp>
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     tofind = [f"({node.address()}|{node.hostid()}).* now UP" for node in tofind]
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>                                    ^^^^^^^^^^^^^
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 1442, in hostid
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     info = self.nodetool('info', capture_output=True, timeout=timeout)[0]
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 880, in nodetool
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     return self._do_run_nodetool(nodetool, capture_output, wait, timeout, verbose)
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
02:42:00.323 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 832, in _do_run_nodetool
02:42:00.324 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     raise NodetoolError(" ".join(nodetool), exit_status, stdout, stderr)
02:42:00.324 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr> ccmlib.node.ToolError: Subprocess /home/runner/.ccm/repository/3.11.19/bin/nodetool -h localhost -p 7200 -Dcom.sun.jndi.rmiURLParsing=legacy info exited with non-zero status; exit status: 1; 
02:42:00.324 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr> stderr: nodetool: Failed to connect to 'localhost:7200' - ConnectException: 'Connection refused (Connection refused)'.
02:42:00.324 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr> 
02:42:02.012 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, remove, --config-dir=/tmp/ccm3906584837836212904]
02:42:02.736 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, create, ccm_1, -i, 127.0.0., -n, 3:0, -p, ByteOrderedPartitioner, -v, 3.11.19, --config-dir=/tmp/ccm4962607349754552624]
02:42:03.359 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> Current cluster is now: ccm_1
02:42:03.393 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, updateconf, auto_snapshot:false, range_request_timeout_in_ms:45000, read_request_timeout_in_ms:45000, write_request_timeout_in_ms:45000, request_timeout_in_ms:45000, enable_user_defined_functions:true, --config-dir=/tmp/ccm4962607349754552624]
02:42:03.837 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, start, --wait-for-binary-proto, --wait-other-notice, --config-dir=/tmp/ccm4962607349754552624]
02:42:25.276 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> [node1 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/runner/.ccm/repository/3.11.19/logs/gc.log due to No such file or directory
02:42:25.276 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> [node2 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/runner/.ccm/repository/3.11.19/logs/gc.log due to No such file or directory
02:42:25.276 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> [node3 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/runner/.ccm/repository/3.11.19/logs/gc.log due to No such file or directory
Error:  Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 46.538 s <<< FAILURE! - in com.datastax.oss.driver.core.metadata.SchemaAgreementIT
Error:  com.datastax.oss.driver.core.metadata.SchemaAgreementIT.should_agree_when_up_nodes_agree  Time elapsed: 7.94 s  <<< ERROR!
java.lang.RuntimeException: The command '[ccm, node2, start, --wait-for-binary-proto, --wait-other-notice, --config-dir=/tmp/ccm3906584837836212904]' failed to execute
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.execute(CcmBridge.java:587)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.execute(CcmBridge.java:532)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.startWithArgs(CcmBridge.java:458)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.start(CcmBridge.java:489)
	at com.datastax.oss.driver.core.metadata.SchemaAgreementIT.should_agree_when_up_nodes_agree(SchemaAgreementIT.java:92)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:49)
	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:120)
	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:95)
	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:69)
	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:146)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385)
	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
	at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495)
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
	at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)
	at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.execute(CcmBridge.java:578)
	... 48 more