Adjust timeouts #3
Annotations
3 errors and 5 warnings
|
Run DeepSeek long seq len module tests
Process completed with exit code 137.
|
|
Run DeepSeek long seq len module tests:
models/demos/deepseek_v3/tests/test_mla.py#L508
test_forward_pass[run_test_forward_pass_mla1d-model.layers.0.self_attn-device_params0-mode_prefill_seq_32768_batch_1]
RuntimeError: TT_FATAL @ /project/ttnn/cpp/ttnn/operations/data_movement/reshape_view/reshape_common.cpp:50: new_volume == old_volume
info:
Invalid arguments to reshape
backtrace:
--- /opt/venv/lib/python3.10/site-packages/ttnn/build/lib/_ttnncpp.so(+0xba1068) [0x7575ffc30068]
--- ttnn::operations::data_movement::detail::infer_dims_for_reshape(tt::tt_metal::Tensor const&, std::span<int const, 18446744073709551615ul>)
--- ttnn::operations::data_movement::ReshapeViewOperation::invoke(tt::tt_metal::Tensor const&, std::span<int const, 18446744073709551615ul>, std::optional<tt::tt_metal::MemoryConfig> const&, std::optional<std::variant<unsigned int, float> > const&, ttnn::TileReshapeMapMode, std::optional<tt::tt_metal::CoreRangeSet> const&)
--- /opt/venv/lib/python3.10/site-packages/ttnn/_ttnn.cpython-310-x86_64-linux-gnu.so(+0x5cebc3) [0x757601ea2bc3]
--- /opt/venv/lib/python3.10/site-packages/ttnn/_ttnn.cpython-310-x86_64-linux-gnu.so(+0x244105) [0x757601b18105]
--- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x253) [0x5775b401b593]
--- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc]
--- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564]
--- /opt/venv/bin/python3(PyObject_Call+0xbb) [0x5775b4033fdb]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b]
--- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0xc4) [0x5775b401b404]
--- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc]
--- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564]
--- /opt/venv/bin/python3(_PyObject_MakeTpCall+0x25b) [0x5775b401c23b]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x5fe9) [0x5775b4015ed9]
--- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x6c0) [0x5775b40105b0]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(PyObject_Call+0x122) [0x5775b4034042]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x16d) [0x5775b401b4ad]
--- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc]
--- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564]
--- /opt/venv/bin/python3(_PyObject_MakeTpCall+0x25b) [0x5775b401c23b]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x6803) [0x5775b40166f3]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x8af) [0x5775b401079f]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x16d) [0x5775b401b4ad]
--- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc]
--- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564]
--- /opt/venv/bin/python3(PyObject_Call+0xbb) [0x5775b4033fdb]
--- /opt
|
|
Run DeepSeek long seq len module tests:
models/demos/deepseek_v3/tests/test_mla.py#L508
test_forward_pass[run_test_forward_pass_mla1d-None-device_params0-mode_prefill_seq_32768_batch_1]
RuntimeError: TT_FATAL @ /project/ttnn/cpp/ttnn/operations/data_movement/reshape_view/reshape_common.cpp:50: new_volume == old_volume
info:
Invalid arguments to reshape
backtrace:
--- /opt/venv/lib/python3.10/site-packages/ttnn/build/lib/_ttnncpp.so(+0xba1068) [0x7575ffc30068]
--- ttnn::operations::data_movement::detail::infer_dims_for_reshape(tt::tt_metal::Tensor const&, std::span<int const, 18446744073709551615ul>)
--- ttnn::operations::data_movement::ReshapeViewOperation::invoke(tt::tt_metal::Tensor const&, std::span<int const, 18446744073709551615ul>, std::optional<tt::tt_metal::MemoryConfig> const&, std::optional<std::variant<unsigned int, float> > const&, ttnn::TileReshapeMapMode, std::optional<tt::tt_metal::CoreRangeSet> const&)
--- /opt/venv/lib/python3.10/site-packages/ttnn/_ttnn.cpython-310-x86_64-linux-gnu.so(+0x5cebc3) [0x757601ea2bc3]
--- /opt/venv/lib/python3.10/site-packages/ttnn/_ttnn.cpython-310-x86_64-linux-gnu.so(+0x244105) [0x757601b18105]
--- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x253) [0x5775b401b593]
--- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc]
--- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564]
--- /opt/venv/bin/python3(PyObject_Call+0xbb) [0x5775b4033fdb]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b]
--- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0xc4) [0x5775b401b404]
--- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc]
--- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564]
--- /opt/venv/bin/python3(_PyObject_MakeTpCall+0x25b) [0x5775b401c23b]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x5fe9) [0x5775b4015ed9]
--- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x6c0) [0x5775b40105b0]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(PyObject_Call+0x122) [0x5775b4034042]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x16d) [0x5775b401b4ad]
--- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc]
--- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564]
--- /opt/venv/bin/python3(_PyObject_MakeTpCall+0x25b) [0x5775b401c23b]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x6803) [0x5775b40166f3]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x8af) [0x5775b401079f]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x285b) [0x5775b401274b]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(+0x1983a1) [0x5775b40333a1]
--- /opt/venv/bin/python3(_PyEval_EvalFrameDefault+0x56e2) [0x5775b40155d2]
--- /opt/venv/bin/python3(_PyFunction_Vectorcall+0x7c) [0x5775b40261ac]
--- /opt/venv/bin/python3(_PyObject_FastCallDictTstate+0x16d) [0x5775b401b4ad]
--- /opt/venv/bin/python3(_PyObject_Call_Prepend+0x5c) [0x5775b40304bc]
--- /opt/venv/bin/python3(+0x29d564) [0x5775b4138564]
--- /opt/venv/bin/python3(PyObject_Call+0xbb) [0x5775b4033fdb]
--- /opt/venv/bin/python3(_P
|
|
Run tenstorrent/tt-metal/.github/actions/upload-artifact-with-job-uuid@main
No files were found with the provided path: /work/generated/test_reports/. No artifacts will be uploaded.
|
|
Run DeepSeek long seq len module tests:
/opt/venv/lib/python3.10/site-packages/llama_models/llama3/api/datatypes.py#L162
Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details
|
|
Run DeepSeek long seq len module tests:
/opt/venv/lib/python3.10/site-packages/llama_models/llama3/api/datatypes.py#L137
Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details
|
|
Run DeepSeek long seq len module tests:
/opt/venv/lib/python3.10/site-packages/llama_models/llama3/api/datatypes.py#L120
Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details
|
|
Run DeepSeek long seq len module tests:
/opt/venv/lib/python3.10/site-packages/pydantic/_internal/_config.py#L291
Support for class-based `config` is deprecated, use ConfigDict instead.
|
Loading