Skip to content

Adjust timeouts

Adjust timeouts #3

Re-run triggered January 31, 2026 07:09
Status Failure
Total duration 47m 11s
Artifacts 3
build-artifact  /  parse-platform
5s
build-artifact / parse-platform
build-artifact  /  ...  /  check-docker-images
21s
build-artifact / build-docker-image / check-docker-images
build-artifact  /  download-artifacts
build-artifact / download-artifacts
build-artifact  /  determine-python-version
3s
build-artifact / determine-python-version
build-artifact  /  ...  /  🐳️ Build Ubuntu images
build-artifact / build-docker-image / 🐳️ Build Ubuntu images
build-artifact  /  ...  /  🐳️ Build ManyLinux image
build-artifact / build-docker-image / 🐳️ Build ManyLinux image
build-artifact  /  ...  /  🔄 Update latest tag
build-artifact / build-docker-image / 🔄 Update latest tag
build-artifact  /  🛠️ Build Release ubuntu 22.04
5m 36s
build-artifact / 🛠️ Build Release ubuntu 22.04
build-artifact  /  ...  /  🐍 Build wheel (Python 3.10)
6m 3s
build-artifact / 🐍 Build wheel (Python 3.10) / 🐍 Build wheel (Python 3.10)
galaxy-deepseek-tests-long  /  galaxy-deepseek-tests-long-impl
20m 21s
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl
Fit to window
Zoom out
Zoom in

Annotations

3 errors and 5 warnings
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl
Process completed with exit code 137.
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl: models/demos/deepseek_v3/tests/test_mla.py#L508
test_forward_pass[run_test_forward_pass_mla1d-model.layers.0.self_attn-device_params0-mode_prefill_seq_32768_batch_1] RuntimeError: TT_FATAL @ /project/ttnn/cpp/ttnn/operations/data_movement/reshape_view/reshape_common.cpp:50: new_volume == old_volume info: Invalid arguments to reshape backtrace: --- /opt/venv/lib/python3.10/site-packages/ttnn/build/lib/_ttnncpp.so(+0xba1068) [0x7575ffc30068] --- ttnn::operations::data_movement::detail::infer_dims_for_reshape(tt::tt_metal::Tensor const&, std::span<int const, 18446744073709551615ul>) --- ttnn::operations::data_movement::ReshapeViewOperation::invoke(tt::tt_metal::Tensor const&, std::span<int const, 18446744073709551615ul>, std::optional<tt::tt_metal::MemoryConfig> const&, std::optional<std::variant<unsigned int, float> > const&, ttnn::TileReshapeMapMode, std::optional<tt::tt_metal::CoreRangeSet> const&) --- /opt/venv/lib/python3.10/site-packages/ttnn/_ttnn.cpython-310-x86_64-linux-gnu.so(+0x5cebc3) [0x757601ea2bc3] --- /opt/venv/lib/python3.10/site-packages/ttnn/_ttnn.cpython-310-x86_64-linux-gnu.so(+0x244105) [0x757601b18105] --- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x253) [0x5775b401b593] --- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc] --- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564] --- /opt/venv/bin/python3(PyObject_Call+0xbb) [0x5775b4033fdb] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b] --- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0xc4) [0x5775b401b404] --- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc] --- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564] --- /opt/venv/bin/python3(_PyObject_MakeTpCall+0x25b) [0x5775b401c23b] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x5fe9) [0x5775b4015ed9] --- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x6c0) [0x5775b40105b0] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(PyObject_Call+0x122) [0x5775b4034042] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x16d) [0x5775b401b4ad] --- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc] --- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564] --- /opt/venv/bin/python3(_PyObject_MakeTpCall+0x25b) [0x5775b401c23b] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x6803) [0x5775b40166f3] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x8af) [0x5775b401079f] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x16d) [0x5775b401b4ad] --- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc] --- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564] --- /opt/venv/bin/python3(PyObject_Call+0xbb) [0x5775b4033fdb] --- /opt
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl: models/demos/deepseek_v3/tests/test_mla.py#L508
test_forward_pass[run_test_forward_pass_mla1d-None-device_params0-mode_prefill_seq_32768_batch_1] RuntimeError: TT_FATAL @ /project/ttnn/cpp/ttnn/operations/data_movement/reshape_view/reshape_common.cpp:50: new_volume == old_volume info: Invalid arguments to reshape backtrace: --- /opt/venv/lib/python3.10/site-packages/ttnn/build/lib/_ttnncpp.so(+0xba1068) [0x7575ffc30068] --- ttnn::operations::data_movement::detail::infer_dims_for_reshape(tt::tt_metal::Tensor const&, std::span<int const, 18446744073709551615ul>) --- ttnn::operations::data_movement::ReshapeViewOperation::invoke(tt::tt_metal::Tensor const&, std::span<int const, 18446744073709551615ul>, std::optional<tt::tt_metal::MemoryConfig> const&, std::optional<std::variant<unsigned int, float> > const&, ttnn::TileReshapeMapMode, std::optional<tt::tt_metal::CoreRangeSet> const&) --- /opt/venv/lib/python3.10/site-packages/ttnn/_ttnn.cpython-310-x86_64-linux-gnu.so(+0x5cebc3) [0x757601ea2bc3] --- /opt/venv/lib/python3.10/site-packages/ttnn/_ttnn.cpython-310-x86_64-linux-gnu.so(+0x244105) [0x757601b18105] --- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x253) [0x5775b401b593] --- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc] --- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564] --- /opt/venv/bin/python3(PyObject_Call+0xbb) [0x5775b4033fdb] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b] --- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0xc4) [0x5775b401b404] --- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc] --- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564] --- /opt/venv/bin/python3(_PyObject_MakeTpCall+0x25b) [0x5775b401c23b] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x5fe9) [0x5775b4015ed9] --- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x6c0) [0x5775b40105b0] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(PyObject_Call+0x122) [0x5775b4034042] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x16d) [0x5775b401b4ad] --- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc] --- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564] --- /opt/venv/bin/python3(_PyObject_MakeTpCall+0x25b) [0x5775b401c23b] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x6803) [0x5775b40166f3] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x8af) [0x5775b401079f] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1] --- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2] --- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac] --- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x16d) [0x5775b401b4ad] --- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc] --- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564] --- /opt/venv/bin/python3(PyObject_Call+0xbb) [0x5775b4033fdb] --- /opt/venv/bin/python3(_P
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl
No files were found with the provided path: /work/generated/test_reports/. No artifacts will be uploaded.
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl: /opt/venv/lib/python3.10/site-packages/llama_models/llama3/api/datatypes.py#L162
Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl: /opt/venv/lib/python3.10/site-packages/llama_models/llama3/api/datatypes.py#L137
Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl: /opt/venv/lib/python3.10/site-packages/llama_models/llama3/api/datatypes.py#L120
Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details
galaxy-deepseek-tests-long / galaxy-deepseek-tests-long-impl: /opt/venv/lib/python3.10/site-packages/pydantic/_internal/_config.py#L291
Support for class-based `config` is deprecated, use ConfigDict instead.