The action 'Galaxy Llama3 demo tests' has timed out after 20 minutes.

Process completed with exit code 1.

test_flux1_pipeline[wormhole_b0-yes_use_cache-not_traced-encoder_device-4x8sp0tp1-dev-1024-1024-28-device_params0-True] OSError: You are trying to access a gated repo. Make sure to have access to it at https://huggingface.co/black-forest-labs/FLUX.1-dev. 401 Client Error. (Request ID: Root=1-698fe5a1-747aac897cea977b1f4821ab;a624d46d-d074-4590-aed8-3b364049e892) Cannot access gated repo for url https://huggingface.co/black-forest-labs/FLUX.1-dev/resolve/main/tokenizer/tokenizer_config.json. Access to model black-forest-labs/FLUX.1-dev is restricted. You must have access to it and be authenticated to access it. Please log in.

Process completed with exit code 139.

Process completed with exit code 139.

test_qwen_demo[wormhole_b0-device_params0-mesh_device0-performance-full] AssertionError: Throughput is out of targets 58 - 65 t/s/u in 199 iterations assert 199 <= 189.1

The action 'Galaxy Qwen3-32B long context demo tests' has timed out after 20 minutes.

Process completed with exit code 1.

test_gpt_oss_demo[wormhole_b0-mesh_device0-fabric_1d_ring-batch128-mesh_4x8] RuntimeError: TT_THROW @ /project/tt_metal/impl/dispatch/system_memory_manager.cpp:627: tt::exception info: TIMEOUT: device timeout, potential hang detected, the device is unrecoverable backtrace: --- /opt/venv/lib/python3.10/site-packages/ttnn/build/lib/_ttnncpp.so(+0xb997b8) [0x7b9f4fe1a7b8] --- /opt/venv/lib/python3.10/site-packages/ttnn/build/lib/libtt_metal.so(+0x5cf674) [0x7b9f4e82d674] --- tt::tt_metal::buffer_dispatch::copy_completion_queue_data_into_user_space(tt::tt_metal::ReadBufferDescriptor const&, int, unsigned short, unsigned int, tt::tt_metal::SystemMemoryManager&, std::atomic<bool>&) --- /opt/venv/lib/python3.10/site-packages/ttnn/build/lib/libtt_metal.so(+0x8ba73e) [0x7b9f4eb1873e] --- /opt/venv/lib/python3.10/site-packages/ttnn/build/lib/libtt_metal.so(+0x7836e0) [0x7b9f4e9e16e0] --- /lib/x86_64-linux-gnu/libstdc++.so.6(+0xdc253) [0x7ba00fefd253] --- /lib/x86_64-linux-gnu/libc.so.6(+0x94ac3) [0x7ba012ff2ac3] --- /lib/x86_64-linux-gnu/libc.so.6(clone+0x44) [0x7ba013083a84]

build_verbosity 2 is not supported for build frontend. Ignoring.

Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details

Support for class-based `config` is deprecated, use ConfigDict instead.

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Benchmark data directory 'generated/benchmark_data' does not exist

Use load_torch_state_dict instead

Use load_torch_state_dict instead

builtin type SwigPyObject has no __module__ attribute

builtin type SwigPyPacked has no __module__ attribute

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Benchmark data directory 'generated/benchmark_data' does not exist

In CPU autocast, but the target dtype is not supported. Disabling autocast. CPU Autocast only supports dtype of torch.bfloat16, torch.float16 currently.

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

builtin type SwigPyObject has no __module__ attribute

builtin type SwigPyPacked has no __module__ attribute

Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Benchmark data directory 'generated/benchmark_data' does not exist

builtin type SwigPyObject has no __module__ attribute

builtin type SwigPyPacked has no __module__ attribute

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Benchmark data directory 'generated/benchmark_data' does not exist

invalid value encountered in divide

Use load_torch_state_dict instead

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Benchmark data directory 'generated/benchmark_data' does not exist

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Benchmark data directory 'generated/benchmark_data' does not exist

Benchmark data directory 'generated/benchmark_data' does not exist

builtin type SwigPyObject has no __module__ attribute

builtin type SwigPyPacked has no __module__ attribute

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

No files were found with the provided path: /work/generated/test_reports/. No artifacts will be uploaded.

Benchmark data directory 'generated/benchmark_data' does not exist

builtin type SwigPyObject has no __module__ attribute

builtin type SwigPyPacked has no __module__ attribute

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Test functions should return None, but models/demos/tg/falcon7b/demo_tg.py::test_demo_multichip[wormhole_b0-user_input0-32chipTG-perf_mode_2048_stochastic_verify] returned <class 'tuple'>. Did you mean to use `assert` instead of `return`? See https://docs.pytest.org/en/stable/how-to/assert.html#return-not-none for more information.

Test functions should return None, but models/demos/tg/falcon7b/demo_tg.py::test_demo_multichip[wormhole_b0-user_input0-32chipTG-perf_mode_1024_stochastic_verify] returned <class 'tuple'>. Did you mean to use `assert` instead of `return`? See https://docs.pytest.org/en/stable/how-to/assert.html#return-not-none for more information.

Test functions should return None, but models/demos/tg/falcon7b/demo_tg.py::test_demo_multichip[wormhole_b0-user_input0-32chipTG-perf_mode_128_stochastic_verify] returned <class 'tuple'>. Did you mean to use `assert` instead of `return`? See https://docs.pytest.org/en/stable/how-to/assert.html#return-not-none for more information.

Support for class-based `config` is deprecated, use ConfigDict instead.

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Benchmark data directory 'generated/benchmark_data' does not exist

builtin type SwigPyObject has no __module__ attribute

builtin type SwigPyPacked has no __module__ attribute

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

No files were found with the provided path: /work/generated/test_reports/. No artifacts will be uploaded.

Benchmark data directory 'generated/benchmark_data' does not exist

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details

Support for class-based `config` is deprecated, use ConfigDict instead.

Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.

Pydantic V1 style `@validator` validators are deprecated. You should migrate to Pydantic V2 style `@field_validator` validators, see the migration guide for more details

Field "model_name" in OpTest has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.

Support for class-based `config` is deprecated, use ConfigDict instead.

Support for class-based `config` is deprecated, use ConfigDict instead.