Skip to content

4.x: AddedNodeIT.should_signal_and_create_pool_when_node_gets_added is failing on cassandra #495

Open
@dkropachev

Description

@dkropachev

failed on CICD:

[INFO] Running com.datastax.oss.driver.core.session.AddedNodeIT
02:42:52.725 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, add, -i, 127.0.0.4, -d, dc1, node4, --config-dir=/tmp/ccm2938373165999800475]
02:42:53.120 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, node4, start, --wait-for-binary-proto, --wait-other-notice, --config-dir=/tmp/ccm2938373165999800475]
02:42:56.523 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr> Traceback (most recent call last):
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/bin/ccm", line 74, in <module>
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     cmd.run()
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/cmds/node_cmds.py", line 196, in run
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     self.node.start(not self.options.no_join_ring,
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 675, in start
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     node.watch_log_for_alive(self, from_mark=mark)
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 534, in watch_log_for_alive
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     tofind = [f"({node.address()}|{node.hostid()}).* now UP" for node in tofind]
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 534, in <listcomp>
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     tofind = [f"({node.address()}|{node.hostid()}).* now UP" for node in tofind]
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>                                    ^^^^^^^^^^^^^
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 1442, in hostid
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     info = self.nodetool('info', capture_output=True, timeout=timeout)[0]
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 880, in nodetool
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     return self._do_run_nodetool(nodetool, capture_output, wait, timeout, verbose)
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
02:42:56.524 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>   File "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/ccmlib/node.py", line 832, in _do_run_nodetool
02:42:56.525 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr>     raise NodetoolError(" ".join(nodetool), exit_status, stdout, stderr)
02:42:56.525 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr> ccmlib.node.ToolError: Subprocess /home/runner/.ccm/repository/3.11.19/bin/nodetool -h localhost -p 7400 -Dcom.sun.jndi.rmiURLParsing=legacy info exited with non-zero status; exit status: 1; 
02:42:56.525 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr> stderr: nodetool: Failed to connect to 'localhost:7400' - ConnectException: 'Connection refused (Connection refused)'.
02:42:56.525 [Exec Stream Pumper] ERROR c.d.o.d.api.testinfra.ccm.CcmBridge - ccmerr> 
02:42:56.564 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, remove, --config-dir=/tmp/ccm2938373165999800475]
02:42:57.330 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, create, ccm_1, -i, 127.0.0., -n, 4:0, -v, 3.11.19, --config-dir=/tmp/ccm1401130618894801876]
02:42:58.097 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> Current cluster is now: ccm_1
02:42:58.128 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, updateconf, auto_snapshot:false, enable_user_defined_functions:true, --config-dir=/tmp/ccm1401130618894801876]
02:42:58.643 [main] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - Executing: [ccm, start, --wait-for-binary-proto, --wait-other-notice, --config-dir=/tmp/ccm1401130618894801876]
02:43:24.395 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> [node1 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/runner/.ccm/repository/3.11.19/logs/gc.log due to No such file or directory
02:43:24.395 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> [node2 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/runner/.ccm/repository/3.11.19/logs/gc.log due to No such file or directory
02:43:24.395 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> [node3 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/runner/.ccm/repository/3.11.19/logs/gc.log due to No such file or directory
02:43:24.395 [Exec Stream Pumper] INFO  c.d.o.d.api.testinfra.ccm.CcmBridge - ccmout> [node4 ERROR] OpenJDK 64-Bit Server VM warning: Cannot open file /home/runner/.ccm/repository/3.11.19/logs/gc.log due to No such file or directory
Error:  Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 31.85 s <<< FAILURE! - in com.datastax.oss.driver.core.session.AddedNodeIT
Error:  com.datastax.oss.driver.core.session.AddedNodeIT.should_signal_and_create_pool_when_node_gets_added  Time elapsed: 3.964 s  <<< ERROR!
java.lang.RuntimeException: The command '[ccm, node4, start, --wait-for-binary-proto, --wait-other-notice, --config-dir=/tmp/ccm2938373165999800475]' failed to execute
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.execute(CcmBridge.java:587)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.execute(CcmBridge.java:532)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.startWithArgs(CcmBridge.java:458)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.start(CcmBridge.java:489)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.add(CcmBridge.java:506)
	at com.datastax.oss.driver.core.session.AddedNodeIT.should_signal_and_create_pool_when_node_gets_added(AddedNodeIT.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:49)
	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:120)
	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:95)
	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:69)
	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:146)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:385)
	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
	at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:507)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:495)
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
	at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)
	at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
	at com.datastax.oss.driver.api.testinfra.ccm.CcmBridge.execute(CcmBridge.java:578)
	... 46 more

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions