Test failure: test_table_migration_convert_manged_to_external #4702
Description
❌ test_table_migration_convert_manged_to_external: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task parse_logs failed with message: Workload failed, see run output for details. (8m1.481s)
databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task parse_logs failed with message: Workload failed, see run output for details.
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:36 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.6Mlv/config.yml) doesn't exist.
05:36 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:36 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
05:36 INFO [databricks.labs.ucx.install] Fetching installations...
05:36 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.6Mlv is corrupted. Skipping...
05:36 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:36 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:36 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:36 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+220251025053654
05:36 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:37 INFO [databricks.labs.ucx.install] Creating dashboards...
05:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.6Mlv/README for the next steps.
05:37 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
05:37 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/828705647263610
05:37 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
05:37 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/828705647263610/runs/641314927643194
05:37 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/828705647263610
05:37 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:39 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/147942178790865
05:39 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-tables job: None
05:39 INFO [databricks.labs.ucx.installer.workflows] Started migrate-tables job: https://DATABRICKS_HOST#job/147942178790865/runs/597334977186285
05:39 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/147942178790865
05:39 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:36 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.6Mlv/config.yml) doesn't exist.
05:36 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:36 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
05:36 INFO [databricks.labs.ucx.install] Fetching installations...
05:36 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.6Mlv is corrupted. Skipping...
05:36 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:36 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:36 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:36 INFO [databricks.labs.ucx.install] Installing UCX v0.60.2+220251025053654
05:36 INFO [databricks.labs.ucx.install] Creating ucx schemas...
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=convert-wasbs-to-adls-gen2-experimental
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assess-workflows
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
05:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
05:37 INFO [databricks.labs.ucx.install] Creating dashboards...
05:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
05:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
05:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
05:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
05:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
05:37 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.6Mlv/README for the next steps.
05:37 INFO [databricks.labs.ucx.progress.install] Installation completed successfully!
05:37 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/828705647263610
05:37 INFO [databricks.labs.ucx.installer.workflows] Named parameters for assessment job: None
05:37 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/828705647263610/runs/641314927643194
05:37 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/828705647263610
05:37 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:39 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/147942178790865
05:39 INFO [databricks.labs.ucx.installer.workflows] Named parameters for migrate-tables job: None
05:39 INFO [databricks.labs.ucx.installer.workflows] Started migrate-tables job: https://DATABRICKS_HOST#job/147942178790865/runs/597334977186285
05:39 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/147942178790865
05:39 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
05:43 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+220251025053654 from https://DATABRICKS_HOST
05:43 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_s8eji1jtq
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1118475242132688, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=147942178790865, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=285654371799888, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=955136803995648, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1004390625716326, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=590711882463364, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=444189445270612, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=683047855614989, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=975331763101258, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=963575370821717, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=828705647263610, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=597846356155687, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=854131629889740, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=981931667611554, as it is no longer needed
05:44 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1124190869137026, as it is no longer needed
05:44 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:44 INFO [databricks.labs.ucx.install] Deleting secret scope
05:44 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
Running from nightly #671