Skip to content
MaxText Package Tests

feat(data): Support auto-tune for the number of grain workers #2532

Sign in to view logs

feat(data): Support auto-tune for the number of grain workers

feat(data): Support auto-tune for the number of grain workers #2532

Triggered via pull request November 7, 2025 07:41
@bzantiumbzantium
synchronize #2510
bzantium:feature/#2509
Status Failure
Total duration 30m 24s
Artifacts 1

build_and_test_maxtext.yml

on: pull_request
Build and upload maxtext package  /  Build and upload maxtext package (v4-8)
33s
Build and upload maxtext package / Build and upload maxtext package (v4-8)
Matrix: maxtext_cpu_unit_tests
Matrix: maxtext_gpu_integration_tests
Matrix: maxtext_gpu_unit_tests
Matrix: maxtext_tpu_integration_tests
Matrix: maxtext_tpu_unit_tests
Notify failed build
5s
Notify failed build
Fit to window
Zoom out
Zoom in

Annotations

6 errors and 13 warnings
maxtext_tpu_unit_tests (py312) / run
Executing the custom container implementation failed. Please contact your self hosted runner administrator.
maxtext_tpu_unit_tests (py312) / run
Process completed with exit code 1.
maxtext_tpu_unit_tests (py312) / run
Error: backoff timeout
maxtext_tpu_unit_tests (py312) / run
Executing the custom container implementation failed. Please contact your self hosted runner administrator.
maxtext_tpu_unit_tests (py312) / run
Process completed with exit code 1.
maxtext_tpu_unit_tests (py312) / run
Error: backoff timeout
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"STATE_isPost=true\" \"STATE_setSafeDirectory=true\" \"STATE_repositoryPath=/__w/maxtext/maxtext\" \"INPUT_REPOSITORY=AI-Hypercomputer/maxtext\" \"INPUT_REF=\" \"INPUT_TOKEN=***\" \"INPUT_SSH-KEY=\" \"INPUT_SSH-KNOWN-HOSTS=\" \"INPUT_SSH-STRICT=true\" \"INPUT_SSH-USER=git\" \"INPUT_PERSIST-CREDENTIALS=true\" \"INPUT_PATH=\" \"INPUT_CLEAN=true\" \"INPUT_FILTER=\" \"INPUT_SPARSE-CHECKOUT=\" \"INPUT_SPARSE-CHECKOUT-CONE-MODE=true\" \"INPUT_FETCH-DEPTH=1\" \"INPUT_FETCH-TAGS=false\" \"INPUT_SHOW-PROGRESS=true\" \"INPUT_LFS=false\" \"INPUT_SUBMODULES=false\" \"INPUT_SET-SAFE-DIRECTORY=true\" \"INPUT_GITHUB-SERVER-URL=\" \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__actions_checkout\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=actions/checkout\" \"GITHUB_ACTION_REF=11bd71901bbe5b1630ceea73d27597364c9af683\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" \"ACTIONS_RUNTIME_URL=https://pipelinesghubeus13.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RUNTIME_TOKEN=***" \"ACTIONS_CACHE_URL=https://acghubeus2.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RESULTS_URL=https://results-receiver.actions.githubusercontent.com/\" \"ACTIONS_CACHE_SERVICE_V2=True\" /__e/node20/bin/node /__w/_actions/actions/checkout/11bd71901bbe5b1630ceea73d27597364c9af683/dist/index.js\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"STATE_isPost=true\" \"STATE_setSafeDirectory=true\" \"STATE_repositoryPath=/__w/maxtext/maxtext\" \"INPUT_REPOSITORY=AI-Hypercomputer/maxtext\" \"INPUT_REF=\" \"INPUT_TOKEN=***\" \"INPUT_SSH-KEY=\" \"INPUT_SSH-KNOWN-HOSTS=\" \"INPUT_SSH-STRICT=true\" \"INPUT_SSH-USER=git\" \"INPUT_PERSIST-CREDENTIALS=true\" \"INPUT_PATH=\" \"INPUT_CLEAN=true\" \"INPUT_FILTER=\" \"INPUT_SPARSE-CHECKOUT=\" \"INPUT_SPARSE-CHECKOUT-CONE-MODE=true\" \"INPUT_FETCH-DEPTH=1\" \"INPUT_FETCH-TAGS=false\" \"INPUT_SHOW-PROGRESS=true\" \"INPUT_LFS=false\" \"INPUT_SUBMODULES=false\" \"INPUT_SET-SAFE-DIRECTORY=true\" \"INPUT_GITHUB-SERVER-URL=\" \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__actions_checkout\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=actions/checkout\" \"GITHUB_ACTION_REF=11bd71901bbe5b1630ceea73d27597364c9af683\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" \"ACTIONS_RUNTIME_URL=https://pipelinesghubeus13.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RUNTIME_TOKEN=***" \"ACTIONS_CACHE_URL=https://acghubeus2.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RESULTS_URL=https://results-receiver.actions.githubusercontent.com/\" \"ACTIONS_CACHE_SERVICE_V2=True\" /__e/node20/bin/node /__w/_actions/actions/checkout/11bd71901bbe5b1630ceea73d27597364c9af683/dist/index.js\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"STATE_isPost=true\" \"STATE_setSafeDirectory=true\" \"STATE_repositoryPath=/__w/maxtext/maxtext\" \"INPUT_REPOSITORY=AI-Hypercomputer/maxtext\" \"INPUT_REF=\" \"INPUT_TOKEN=***\" \"INPUT_SSH-KEY=\" \"INPUT_SSH-KNOWN-HOSTS=\" \"INPUT_SSH-STRICT=true\" \"INPUT_SSH-USER=git\" \"INPUT_PERSIST-CREDENTIALS=true\" \"INPUT_PATH=\" \"INPUT_CLEAN=true\" \"INPUT_FILTER=\" \"INPUT_SPARSE-CHECKOUT=\" \"INPUT_SPARSE-CHECKOUT-CONE-MODE=true\" \"INPUT_FETCH-DEPTH=1\" \"INPUT_FETCH-TAGS=false\" \"INPUT_SHOW-PROGRESS=true\" \"INPUT_LFS=false\" \"INPUT_SUBMODULES=false\" \"INPUT_SET-SAFE-DIRECTORY=true\" \"INPUT_GITHUB-SERVER-URL=\" \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__actions_checkout\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=actions/checkout\" \"GITHUB_ACTION_REF=11bd71901bbe5b1630ceea73d27597364c9af683\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" \"ACTIONS_RUNTIME_URL=https://pipelinesghubeus13.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RUNTIME_TOKEN=***" \"ACTIONS_CACHE_URL=https://acghubeus2.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RESULTS_URL=https://results-receiver.actions.githubusercontent.com/\" \"ACTIONS_CACHE_SERVICE_V2=True\" /__e/node20/bin/node /__w/_actions/actions/checkout/11bd71901bbe5b1630ceea73d27597364c9af683/dist/index.js\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"STATE_isPost=true\" \"STATE_setSafeDirectory=true\" \"STATE_repositoryPath=/__w/maxtext/maxtext\" \"INPUT_REPOSITORY=AI-Hypercomputer/maxtext\" \"INPUT_REF=\" \"INPUT_TOKEN=***\" \"INPUT_SSH-KEY=\" \"INPUT_SSH-KNOWN-HOSTS=\" \"INPUT_SSH-STRICT=true\" \"INPUT_SSH-USER=git\" \"INPUT_PERSIST-CREDENTIALS=true\" \"INPUT_PATH=\" \"INPUT_CLEAN=true\" \"INPUT_FILTER=\" \"INPUT_SPARSE-CHECKOUT=\" \"INPUT_SPARSE-CHECKOUT-CONE-MODE=true\" \"INPUT_FETCH-DEPTH=1\" \"INPUT_FETCH-TAGS=false\" \"INPUT_SHOW-PROGRESS=true\" \"INPUT_LFS=false\" \"INPUT_SUBMODULES=false\" \"INPUT_SET-SAFE-DIRECTORY=true\" \"INPUT_GITHUB-SERVER-URL=\" \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__actions_checkout\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=actions/checkout\" \"GITHUB_ACTION_REF=11bd71901bbe5b1630ceea73d27597364c9af683\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" \"ACTIONS_RUNTIME_URL=https://pipelinesghubeus13.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RUNTIME_TOKEN=***" \"ACTIONS_CACHE_URL=https://acghubeus2.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RESULTS_URL=https://results-receiver.actions.githubusercontent.com/\" \"ACTIONS_CACHE_SERVICE_V2=True\" /__e/node20/bin/node /__w/_actions/actions/checkout/11bd71901bbe5b1630ceea73d27597364c9af683/dist/index.js\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"STATE_isPost=true\" \"STATE_setSafeDirectory=true\" \"STATE_repositoryPath=/__w/maxtext/maxtext\" \"INPUT_REPOSITORY=AI-Hypercomputer/maxtext\" \"INPUT_REF=\" \"INPUT_TOKEN=***\" \"INPUT_SSH-KEY=\" \"INPUT_SSH-KNOWN-HOSTS=\" \"INPUT_SSH-STRICT=true\" \"INPUT_SSH-USER=git\" \"INPUT_PERSIST-CREDENTIALS=true\" \"INPUT_PATH=\" \"INPUT_CLEAN=true\" \"INPUT_FILTER=\" \"INPUT_SPARSE-CHECKOUT=\" \"INPUT_SPARSE-CHECKOUT-CONE-MODE=true\" \"INPUT_FETCH-DEPTH=1\" \"INPUT_FETCH-TAGS=false\" \"INPUT_SHOW-PROGRESS=true\" \"INPUT_LFS=false\" \"INPUT_SUBMODULES=false\" \"INPUT_SET-SAFE-DIRECTORY=true\" \"INPUT_GITHUB-SERVER-URL=\" \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__actions_checkout\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=actions/checkout\" \"GITHUB_ACTION_REF=11bd71901bbe5b1630ceea73d27597364c9af683\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" \"ACTIONS_RUNTIME_URL=https://pipelinesghubeus13.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RUNTIME_TOKEN=***" \"ACTIONS_CACHE_URL=https://acghubeus2.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RESULTS_URL=https://results-receiver.actions.githubusercontent.com/\" \"ACTIONS_CACHE_SERVICE_V2=True\" /__e/node20/bin/node /__w/_actions/actions/checkout/11bd71901bbe5b1630ceea73d27597364c9af683/dist/index.js\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"STATE_isPost=true\" \"STATE_setSafeDirectory=true\" \"STATE_repositoryPath=/__w/maxtext/maxtext\" \"INPUT_REPOSITORY=AI-Hypercomputer/maxtext\" \"INPUT_REF=\" \"INPUT_TOKEN=***\" \"INPUT_SSH-KEY=\" \"INPUT_SSH-KNOWN-HOSTS=\" \"INPUT_SSH-STRICT=true\" \"INPUT_SSH-USER=git\" \"INPUT_PERSIST-CREDENTIALS=true\" \"INPUT_PATH=\" \"INPUT_CLEAN=true\" \"INPUT_FILTER=\" \"INPUT_SPARSE-CHECKOUT=\" \"INPUT_SPARSE-CHECKOUT-CONE-MODE=true\" \"INPUT_FETCH-DEPTH=1\" \"INPUT_FETCH-TAGS=false\" \"INPUT_SHOW-PROGRESS=true\" \"INPUT_LFS=false\" \"INPUT_SUBMODULES=false\" \"INPUT_SET-SAFE-DIRECTORY=true\" \"INPUT_GITHUB-SERVER-URL=\" \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__actions_checkout\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=actions/checkout\" \"GITHUB_ACTION_REF=11bd71901bbe5b1630ceea73d27597364c9af683\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" \"ACTIONS_RUNTIME_URL=https://pipelinesghubeus13.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RUNTIME_TOKEN=***" \"ACTIONS_CACHE_URL=https://acghubeus2.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RESULTS_URL=https://results-receiver.actions.githubusercontent.com/\" \"ACTIONS_CACHE_SERVICE_V2=True\" /__e/node20/bin/node /__w/_actions/actions/checkout/11bd71901bbe5b1630ceea73d27597364c9af683/dist/index.js\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"STATE_isPost=true\" \"STATE_setSafeDirectory=true\" \"STATE_repositoryPath=/__w/maxtext/maxtext\" \"INPUT_REPOSITORY=AI-Hypercomputer/maxtext\" \"INPUT_REF=\" \"INPUT_TOKEN=***\" \"INPUT_SSH-KEY=\" \"INPUT_SSH-KNOWN-HOSTS=\" \"INPUT_SSH-STRICT=true\" \"INPUT_SSH-USER=git\" \"INPUT_PERSIST-CREDENTIALS=true\" \"INPUT_PATH=\" \"INPUT_CLEAN=true\" \"INPUT_FILTER=\" \"INPUT_SPARSE-CHECKOUT=\" \"INPUT_SPARSE-CHECKOUT-CONE-MODE=true\" \"INPUT_FETCH-DEPTH=1\" \"INPUT_FETCH-TAGS=false\" \"INPUT_SHOW-PROGRESS=true\" \"INPUT_LFS=false\" \"INPUT_SUBMODULES=false\" \"INPUT_SET-SAFE-DIRECTORY=true\" \"INPUT_GITHUB-SERVER-URL=\" \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__actions_checkout\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=actions/checkout\" \"GITHUB_ACTION_REF=11bd71901bbe5b1630ceea73d27597364c9af683\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_fd77d0c7-df6c-4fda-bbd0-7a8fb911f10e\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" \"ACTIONS_RUNTIME_URL=https://pipelinesghubeus13.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RUNTIME_TOKEN=***" \"ACTIONS_CACHE_URL=https://acghubeus2.actions.githubusercontent.com/ifAZyBvORBJf4huTr2IHYuErk1LmwopbBEkmaEiGPaUn249lFR/\" \"ACTIONS_RESULTS_URL=https://results-receiver.actions.githubusercontent.com/\" \"ACTIONS_CACHE_SERVICE_V2=True\" /__e/node20/bin/node /__w/_actions/actions/checkout/11bd71901bbe5b1630ceea73d27597364c9af683/dist/index.js\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__run_4\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=\" \"GITHUB_ACTION_REF=\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" bash --noprofile --norc -e -o pipefail /__w/_temp/260efc0f-c5cf-4160-936f-779960594e0c.sh\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__run_4\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=\" \"GITHUB_ACTION_REF=\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" bash --noprofile --norc -e -o pipefail /__w/_temp/260efc0f-c5cf-4160-936f-779960594e0c.sh\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__run_4\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=\" \"GITHUB_ACTION_REF=\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" bash --noprofile --norc -e -o pipefail /__w/_temp/260efc0f-c5cf-4160-936f-779960594e0c.sh\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__run_4\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=\" \"GITHUB_ACTION_REF=\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" bash --noprofile --norc -e -o pipefail /__w/_temp/260efc0f-c5cf-4160-936f-779960594e0c.sh\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__run_4\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=\" \"GITHUB_ACTION_REF=\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" bash --noprofile --norc -e -o pipefail /__w/_temp/260efc0f-c5cf-4160-936f-779960594e0c.sh\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".
maxtext_tpu_unit_tests (py312) / run
Retrying execution for ECONNREFUSED or UNAVAILABLE "Error: Error execing #!/bin/sh -l\n\ncd /__w/maxtext/maxtext && exec env \"GITHUB_JOB=run\" \"GITHUB_REF=refs/pull/2510/merge\" \"GITHUB_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY=AI-Hypercomputer/maxtext\" \"GITHUB_REPOSITORY_OWNER=AI-Hypercomputer\" \"GITHUB_REPOSITORY_OWNER_ID=181000646\" \"GITHUB_RUN_ID=19161637094\" \"GITHUB_RUN_NUMBER=2532\" \"GITHUB_RETENTION_DAYS=90\" \"GITHUB_RUN_ATTEMPT=1\" \"GITHUB_ACTOR_ID=19511788\" \"GITHUB_ACTOR=bzantium\" \"GITHUB_WORKFLOW=MaxText Package Tests\" \"GITHUB_HEAD_REF=feature/#2509\" \"GITHUB_BASE_REF=main\" \"GITHUB_EVENT_NAME=pull_request\" \"GITHUB_SERVER_URL=https://github.com\" \"GITHUB_API_URL=https://api.github.com\" \"GITHUB_GRAPHQL_URL=https://api.github.com/graphql\" \"GITHUB_REF_NAME=2510/merge\" \"GITHUB_REF_PROTECTED=false\" \"GITHUB_REF_TYPE=branch\" \"GITHUB_WORKFLOW_REF=AI-Hypercomputer/maxtext/.github/workflows/build_and_test_maxtext.yml@refs/pull/2510/merge\" \"GITHUB_WORKFLOW_SHA=8bddaf4f75b7fc05c1ff7846cdba35741dd3510e\" \"GITHUB_REPOSITORY_ID=607845880\" \"GITHUB_TRIGGERING_ACTOR=bzantium\" \"GITHUB_WORKSPACE=/__w/maxtext/maxtext\" \"GITHUB_ACTION=__run_4\" \"GITHUB_EVENT_PATH=/github/workflow/event.json\" \"GITHUB_ACTION_REPOSITORY=\" \"GITHUB_ACTION_REF=\" \"GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_bf9c3a52-43b0-4f34-8f95-6628e63f62da\" \"RUNNER_OS=Linux\" \"RUNNER_ARCH=X64\" \"RUNNER_NAME=linux-x86-ct4p-240-4tpu-5fh68-runner-bfwvv\" \"RUNNER_ENVIRONMENT=self-hosted\" \"RUNNER_TOOL_CACHE=/__w/_tool\" \"RUNNER_TEMP=/__w/_temp\" \"RUNNER_WORKSPACE=/__w/maxtext\" bash --noprofile --norc -e -o pipefail /__w/_temp/260efc0f-c5cf-4160-936f-779960594e0c.sh\n: Error: 14 UNAVAILABLE: No connection established. Last error: Error: connect ECONNREFUSED 34.118.233.131:50051".

Artifacts

Produced during runtime
Name Size Digest
maxtext-wheel
24.9 MB
sha256:956ce8b0c702155bb366736533b396443f5c300bcda7a236daea1f7de9fea35c