-
Notifications
You must be signed in to change notification settings - Fork 99
Description
❌ test_running_real_assessment_job: AssertionError: Workflow failed: assessment (21m40.814s)
AssertionError: Workflow failed: assessment
assert False
+ where False = validate_step('assessment')
+ where validate_step = <databricks.labs.ucx.installer.workflows.DeployedWorkflows object at 0x7f2a9c48dba0>.validate_step
+ where <databricks.labs.ucx.installer.workflows.DeployedWorkflows object at 0x7f2a9c48dba0> = <tests.integration.conftest.MockInstallationContext object at 0x7f2a9c381b70>.deployed_workflows
[gw2] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
12:14 INFO [tests.integration.conftest] Dashboard Created ucx_D8gB2_ra78b36496: https://DATABRICKS_HOST/sql/dashboards/71e0a451-e992-4ba2-b1ac-70bb98117dfc
12:14 INFO [tests.integration.conftest] Dashboard Created ucx_D0g2I_ra78b36496: https://DATABRICKS_HOST/sql/dashboards/5c20241c-b9be-48ca-b81a-d019e5aa358c
12:14 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.wWnd/config.yml) doesn't exist.
12:14 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
12:14 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
12:14 INFO [databricks.labs.ucx.install] Fetching installations...
12:14 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
12:14 DEBUG [tests.integration.conftest] Waiting for clusters to start...
12:14 DEBUG [tests.integration.conftest] Waiting for clusters to start...
12:14 INFO [databricks.labs.ucx.install] Installing UCX v0.56.1+120250226121424
12:14 INFO [databricks.labs.ucx.install] Creating ucx schemas...
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
12:14 INFO [databricks.labs.ucx.install] Creating dashboards...
12:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
12:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
12:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
12:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.wWnd/README for the next steps.
12:14 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/843416403174751
12:14 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/843416403174751/runs/277571483266002
12:14 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/843416403174751
12:14 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
12:14 INFO [tests.integration.conftest] Dashboard Created ucx_D8gB2_ra78b36496: https://DATABRICKS_HOST/sql/dashboards/71e0a451-e992-4ba2-b1ac-70bb98117dfc
12:14 INFO [tests.integration.conftest] Dashboard Created ucx_D0g2I_ra78b36496: https://DATABRICKS_HOST/sql/dashboards/5c20241c-b9be-48ca-b81a-d019e5aa358c
12:14 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.wWnd/config.yml) doesn't exist.
12:14 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
12:14 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
12:14 INFO [databricks.labs.ucx.install] Fetching installations...
12:14 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
12:14 DEBUG [tests.integration.conftest] Waiting for clusters to start...
12:14 DEBUG [tests.integration.conftest] Waiting for clusters to start...
12:14 INFO [databricks.labs.ucx.install] Installing UCX v0.56.1+120250226121424
12:14 INFO [databricks.labs.ucx.install] Creating ucx schemas...
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy
12:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
12:14 INFO [databricks.labs.ucx.install] Creating dashboards...
12:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress...
12:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment...
12:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration...
12:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main...
12:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups...
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config
12:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.wWnd/README for the next steps.
12:14 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/843416403174751
12:14 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/843416403174751/runs/277571483266002
12:14 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/843416403174751
12:14 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion
12:34 INFO [databricks.labs.ucx.install] Deleting UCX v0.56.1+120250226121424 from https://DATABRICKS_HOST
12:34 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sjhyy
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=722280290884898, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=996198979244282, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1088789279680466, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=249368248740392, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=82059651065082, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=843416403174751, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=795259416839820, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=823310876609643, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=621592337393338, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=373146149151672, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1089773545533436, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=35808813258252, as it is no longer needed
12:35 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=552516167373964, as it is no longer needed
12:35 INFO [databricks.labs.ucx.install] Deleting cluster policy
12:35 INFO [databricks.labs.ucx.install] Deleting secret scope
12:35 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw2] linux -- Python 3.10.16 /home/runner/work/ucx/ucx/.venv/bin/python
Running from nightly #416
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status
Done