Deployment is failing on main #2623
Description
Required prerequisites
- Consult the security policy. If reporting a security vulnerability, do not report the bug using this form. Use the process described in the policy to report the issue.
- Make sure you've read the documentation. Your issue may be addressed there.
- Search the issue tracker to verify that this hasn't already been reported. +1 or comment there if it has.
- If possible, make a PR with a failing test to give us a starting point to work on!
Describe the bug
Deployment is failing with Segmentation fault on the main branch due to failure in test_mpi_api.py
Steps to reproduce the bug
Here is the job
https://github.com/NVIDIA/cuda-quantum/actions/runs/13335693612/job/37254100357#step:8:6360
Fatal Python error: Segmentation fault
Current thread 0x0000e3b78e679800 (most recent call first):
File "/tmp/tests/parallel/test_mpi_api.py", line 19 in testMPI
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/python.py", line 159 in pytest_pyfunc_call
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/python.py", line 1627 in runtest
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 174 in pytest_runtest_call
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 242 in <lambda>
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 341 in from_call
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 241 in call_and_report
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 132 in runtestprotocol
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/runner.py", line 113 in pytest_runtest_protocol
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/main.py", line 362 in pytest_runtestloop
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/main.py", line 337 in _main
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/main.py", line 283 in wrap_session
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/main.py", line 330 in pytest_cmdline_main
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_callers.py", line 103 in _multicall
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pluggy/_hooks.py", line 513 in __call__
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/config/__init__.py", line 175 in main
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/_pytest/config/__init__.py", line 201 in console_main
File "/root/miniconda3/envs/cudaq-env/lib/python3.11/site-packages/pytest/__main__.py", line 9 in <module>
File "<frozen runpy>", line 88 in _run_code
File "<frozen runpy>", line 198 in _run_module_as_main
Extension modules: numpy._core._multiarray_umath, numpy.linalg._umath_linalg, scipy._lib._ccallback_c, cuquantum.bindings._utils, cuquantum.bindings._internal.cudensitymat, cuquantum.bindings.cycudensitymat, cuquantum.bindings.cudensitymat, cuquantum._utils, cuquantum.custatevec._internal.custatevec, cuquantum.custatevec.cycustatevec, cuquantum.custatevec.custatevec, cupy_backends.cuda._softlink, cupy_backends.cuda.api._runtime_enum, cupy_backends.cuda.api.runtime, cupy._util, cupy.cuda.device, fastrlock.rlock, cupy.cuda.memory_hook, cupy_backends.cuda.stream, cupy.cuda.graph, cupy.cuda.stream, cupy_backends.cuda.api._driver_enum, cupy_backends.cuda.api.driver, cupy.cuda.memory, cupy._core.internal, cupy._core._carray, cupy.cuda.texture, cupy.cuda.function, cupy_backends.cuda.libs.nvrtc, cupy.cuda.pinned_memory, cupy.cuda.common, cupy.cuda.cub, cupy_backends.cuda.libs.nvtx, cupy.cuda.thrust, cupy._core._dtype, cupy._core._scalar, cupy._core._accelerator, cupy._core._memory_range, cupy._core._fusion_thread_local, cupy._core._kernel, cupy._core._routines_manipulation, cupy._core._routines_binary, cupy._core._optimize_config, cupy._core._cub_reduction, cupy._core._reduction, cupy._core._routines_math, cupy._core._routines_indexing, cupy._core._routines_linalg, cupy._core._routines_logic, cupy._core._routines_sorting, cupy._core._routines_statistics, cupy._core.dlpack, cupy._core.flags, cupy._core.core, cupy._core._fusion_variable, cupy._core._fusion_trace, cupy._core._fusion_kernel, cupy._core.new_fusion, cupy._core.fusion, cupy._core.raw, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, charset_normalizer.md, scipy.sparse._sparsetools, _csparsetools, scipy.sparse._csparsetools, scipy.linalg._fblas, scipy.linalg._flapack, scipy.linalg.cython_lapack, scipy.linalg._cythonized_array_utils, scipy.linalg._solve_toeplitz, scipy.linalg._decomp_lu_cython, scipy.linalg._matfuncs_sqrtm_triu, scipy.linalg._matfuncs_expm, scipy.linalg._linalg_pythran, scipy.linalg.cython_blas, scipy.linalg._decomp_update, scipy.sparse.linalg._dsolve._superlu, scipy.sparse.linalg._eigen.arpack._arpack, scipy.sparse.linalg._propack._spropack, scipy.sparse.linalg._propack._dpropack, scipy.sparse.linalg._propack._cpropack, scipy.sparse.linalg._propack._zpropack, scipy.sparse.csgraph._tools, scipy.sparse.csgraph._shortest_path, scipy.sparse.csgraph._traversal, scipy.sparse.csgraph._min_spanning_tree, scipy.sparse.csgraph._flow, scipy.sparse.csgraph._matching, scipy.sparse.csgraph._reordering, cupy.fft._cache, cupy.fft._callback, cupy.random._bit_generator, scipy._lib._uarray._uarray, scipy.special._ufuncs_cxx, scipy.special._ufuncs, scipy.special._specfun, scipy.special._comb, scipy.special._ellip_harm_2, cupy.lib._polynomial, cuquantum.cutensornet._internal.cutensornet, cuquantum.cutensornet.cycutensornet, cuquantum.cutensornet.cutensornet, scipy.integrate._odepack, scipy.integrate._quadpack, scipy.integrate._vode, scipy.integrate._dop, scipy.integrate._lsoda, scipy.optimize._group_columns, scipy._lib.messagestream, scipy.optimize._trlib._trlib, scipy.optimize._lbfgsb, _moduleTNC, scipy.optimize._moduleTNC, scipy.optimize._cobyla, scipy.optimize._slsqp, scipy.optimize._minpack, scipy.optimize._lsq.givens_elimination, scipy.optimize._zeros, scipy.optimize._cython_nnls, scipy.linalg._decomp_interpolative, scipy.optimize._bglu_dense, scipy.optimize._lsap, scipy.spatial._ckdtree, scipy.spatial._qhull, scipy.spatial._voronoi, scipy.spatial._distance_wrap, scipy.spatial._hausdorff, scipy.spatial.transform._rotation, scipy.optimize._direct (total: 137)
tmp/tests/parallel/test_mpi_api.py::testMPI
collecting 1 item
collected 1 item
collecting 1 item
collected 1 item
tmp/tests/parallel/test_mpi_api.py::testMPI
tmp/tests/parallel/test_mpi_api.py::testMPI
collecting 1 item
collected 1 item
Fatal Python error: Segmentation fault
Current thread 0x0000f777b2a9c800 (most recent call first):
File "/tmp/tests/parallel/test_mpi_api.py", line 19 in Fatal Python error: Segmentation fault
Expected behavior
Should run successfully
Is this a regression? If it is, put the last known working version (or commit) here.
Not a regression
Environment
- CUDA-Q version: 11272024
- Python version: 3.10.12
- C++ compiler: 11272024
- Operating system:
Suggestions
No response