SUPPORT-11914 add command for mass project update

[jirkasemmler]

Changes:

• add command, which will update data_retention_in_days for all SNFLK projects on stack. see SUPPORT-11914

---

Additional notes

⚠️ Don't forget to release new version after merge

[jirkasemmler]

na GCP e2e (ma jen BQ projekty)

docker compose run --rm dev php cli.php manage:update-data-retention 437-xxx https://connection.e2e.us-east1.gcp.keboola.dev 5
WARN[0000] /Users/jirisemmler/work/keboola/cli/docker-compose.yml: the attribute `version` is obsolete, it will be ignored, please remove it to avoid potential confusion 
Dry run mode. No projects will be updated. Use -f to enable force mode.
Updating all projects with data retention time: 5 days
Found 1 maintainers
Processing maintainer "1" ("Keboola Data Services")
Found 3 organizations for maintainer "1"
-----
Processing organization "1" ("Keboola Internal")
Found 4 projects for organization "1"
Updating data retention for project "2" ("test 2")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "3" ("test 3")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "212" ("Test suite: backend bigquery gcs-paratest-backend-bigquery-2025-04-29_0734")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "214" ("Test suite: backend bigquery gcs-paratest-backend-bigquery-2025-05-12_1911")
 - project does not have Snowflake backend assigned. Skiping.

-----
Processing organization "3" ("Keboola SOX paratest")
Found 2 projects for organization "3"
Updating data retention for project "210" ("Test suite: sox bigquery gcs-paratest-sox-bigquery paratest-sox-bigquery-2025-02-05_1715")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "211" ("Test suite: sox bigquery gcs-paratest-sox-bigquery paratest-sox-bigquery-2025-02-05_1715 linking")
 - project does not have Snowflake backend assigned. Skiping.

-----
Processing organization "4" ("Keboola SOX sync")
Found 2 projects for organization "4"
Updating data retention for project "107" ("Test suite: sox bigquery gcs-sync-sox-bigquery sync-sox-bigquery-2024-05-22_1053")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "108" ("Test suite: sox bigquery gcs-sync-sox-bigquery sync-sox-bigquery-2024-05-22_1053 linking")
 - project does not have Snowflake backend assigned. Skiping.


DONE with following results:

Checked 1 maintainers
Checked 3 organizations
0 projects were disabled
8 projects do not have Snowflake backend
0 projects would be updated in force mode
0 projects had errors during update

[jirkasemmler]

a pak na Azure (je tam toho malo)

docker compose run --rm dev php cli.php manage:update-data-retention 352-xxx https://connection.azure.keboola-testing.com 1 -f
WARN[0000] /Users/jirisemmler/work/keboola/cli/docker-compose.yml: the attribute `version` is obsolete, it will be ignored, please remove it to avoid potential confusion 
Force mode enabled. Projects will be updated.
Updating all projects with data retention time: 1 days
Found 1 maintainers
Processing maintainer "1" ("Keboola Data Services")
Found 12 organizations for maintainer "1"
-----
Processing organization "9" ("Devel")
Found 0 projects for organization "9"
-----
Processing organization "6" ("Dynamic backends")
Found 1 projects for organization "6"
Updating data retention for project "18" ("Tests - Dynamic backends")
 - data retention time successfully updated to 1 days.

-----
Processing organization "12" ("Erik")
Found 1 projects for organization "12"
Updating data retention for project "133" ("Erik")
 - data retention time successfully updated to 1 days.

-----
Processing organization "13" ("jirka test synapse")
Found 1 projects for organization "13"
Updating data retention for project "154" ("Test Synapse->Snowflake")
 - data retention time successfully updated to 1 days.

-----
Processing organization "1" ("Keboola Internal")
Found 28 projects for organization "1"
Updating data retention for project "143" ("Test suite: backend snowflake abs-azure-snflk-abs-part-2 azure-snflk-abs-part-2-2024-05-22_1246")
 - data retention time successfully updated to 1 days.

Updating data retention for project "144" ("Test suite: backend snowflake abs-azure-snflk-abs-part-2 azure-snflk-abs-part-2-2024-05-22_1246 link")
 - data retention time successfully updated to 1 days.

Updating data retention for project "163" ("Test suite: backend snowflake abs-paratest-backend-snowflake-abs-part-1 paratest-backend-snowflake-a")
 - data retention time successfully updated to 1 days.

Updating data retention for project "120" ("Test suite: backend snowflake abs-paratest-backend-snowflake-abs-part-1 paratest-backend-snowflake-a")
 - data retention time successfully updated to 1 days.

Updating data retention for project "159" ("Test suite: backend snowflake abs-paratest-backend-snowflake-abs-part-1 paratest-backend-snowflake-a")
 - data retention time successfully updated to 1 days.

Updating data retention for project "30" ("Test suite: backend snowflake abs-part-2 2021-11-22")
 - data retention time successfully updated to 1 days.

Updating data retention for project "29" ("Test suite: backend snowflake abs-part-2 2021-11-22")
 - data retention time successfully updated to 1 days.

Updating data retention for project "31" ("Test suite: backend snowflake abs-part-2 2021-11-22 linking")
 - data retention time successfully updated to 1 days.

Updating data retention for project "136" ("Test suite: backend synapse abs-backend-synapse-part-2 backend-synapse-part-2-2024-04-15_0618")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "145" ("Test suite: backend synapse abs-backend-synapse-part-2 backend-synapse-part-2-2024-05-23_0558")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "41" ("Test suite: backend synapse abs-managed 2021-04-29")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "40" ("Test suite: backend synapse abs-managed 2022-04-27")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "42" ("Test suite: backend synapse abs-managed 2022-08-02")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "43" ("Test suite: backend synapse abs-managed 2022-08-03")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "44" ("Test suite: backend synapse abs-managed 2022-08-03")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "140" ("Test suite: backend synapse abs-paratest-backend-synapse-part-1 paratest-backend-synapse-part-1-2024")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "82" ("Test suite: backend teradata abs-paratest-backend-teradata-abs-2023-01-26_1407")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "83" ("Test suite: backend teradata abs-paratest-backend-teradata-abs-2023-01-27_0730")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "84" ("Test suite: backend teradata abs-paratest-backend-teradata-abs-2023-01-27_0746")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "85" ("Test suite: backend teradata abs-paratest-backend-teradata-abs-2023-02-01_0845")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "86" ("Test suite: backend teradata abs-paratest-backend-teradata-abs-2023-02-01_0855")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "87" ("Test suite: backend teradata abs-paratest-backend-teradata-abs-2023-02-01_0857")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "89" ("Test suite: backend teradata abs-paratest-backend-teradata-abs-part-2-2023-02-01_1009")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "125" ("Test suite: common snowflake-azure-common-2023-11-13_1224")
 - data retention time successfully updated to 1 days.

Updating data retention for project "32" ("Test suite: common snowflake-common 2021-11-23")
 - data retention time successfully updated to 1 days.

Updating data retention for project "74" ("Test suite: common snowflake-file-storage-azure-2022-09-07_2011")
 - data retention time successfully updated to 1 days.

Updating data retention for project "4" ("Tests - Common")
 - data retention time successfully updated to 1 days.

Updating data retention for project "7" ("Tests - SNFLK - Part 1.0")
 - data retention time successfully updated to 1 days.

-----
Processing organization "3" ("Martin Halamicek")
Found 1 projects for organization "3"
Updating data retention for project "2" ("Martin")
 - data retention time successfully updated to 1 days.

-----
Processing organization "5" ("Martin Junger - Organization")
Found 1 projects for organization "5"
Updating data retention for project "19" ("Sandbox")
 - data retention time successfully updated to 1 days.

-----
Processing organization "4" ("Martin Zajíc")
Found 3 projects for organization "4"
Updating data retention for project "11" ("Local test Synapse")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "75" ("Test tables with configurations")
 - project does not have Snowflake backend assigned. Skiping.

Updating data retention for project "14" ("Tests - SNFLK - P2")
 - data retention time successfully updated to 1 days.

-----
Processing organization "10" ("Mixed SNFLK-TD main")
Found 7 projects for organization "10"
Updating data retention for project "96" ("Test suite: mixed snowflake<->teradata abs linking")
 - data retention time successfully updated to 1 days.

Updating data retention for project "99" ("Test suite: mixed snowflake<->teradata abs linking")
 - data retention time successfully updated to 1 days.

Updating data retention for project "91" ("Test suite: mixed snowflake<->teradata abs main")
 - data retention time successfully updated to 1 days.

Updating data retention for project "92" ("Test suite: mixed snowflake<->teradata abs main")
 - data retention time successfully updated to 1 days.

Updating data retention for project "93" ("Test suite: mixed snowflake<->teradata abs main")
 - data retention time successfully updated to 1 days.

Updating data retention for project "94" ("Test suite: mixed snowflake<->teradata abs main")
 - data retention time successfully updated to 1 days.

Updating data retention for project "97" ("Test suite: mixed snowflake<->teradata abs main")
 - data retention time successfully updated to 1 days.

-----
Processing organization "11" ("Mixed SNFLK-TD other")
Found 2 projects for organization "11"
Updating data retention for project "95" ("Test suite: mixed snowflake<->teradata abs main other org")
 - data retention time successfully updated to 1 days.

Updating data retention for project "98" ("Test suite: mixed snowflake<->teradata abs main other org")
 - data retention time successfully updated to 1 days.

-----
Processing organization "8" ("MixedSuite: SNFLK-SNPS main org")
Found 4 projects for organization "8"
Updating data retention for project "128" ("Test suite: mixed snowflake<->synapse abs linking")
 - data retention time successfully updated to 1 days.

Updating data retention for project "149" ("Test suite: mixed snowflake<->synapse abs linking")
 - data retention time successfully updated to 1 days.

Updating data retention for project "126" ("Test suite: mixed snowflake<->synapse abs main")
 - data retention time successfully updated to 1 days.

Updating data retention for project "147" ("Test suite: mixed snowflake<->synapse abs main")
 - data retention time successfully updated to 1 days.

-----
Processing organization "7" ("MixedSuite: SNFLK-SNPS other org")
Found 2 projects for organization "7"
Updating data retention for project "127" ("Test suite: mixed snowflake<->synapse abs main other org")
 - data retention time successfully updated to 1 days.

Updating data retention for project "148" ("Test suite: mixed snowflake<->synapse abs main other org")
 - data retention time successfully updated to 1 days.


DONE with following results:

Checked 1 maintainers
Checked 12 organizations
0 projects were disabled
17 projects do not have Snowflake backend
34 projects updated
0 projects had errors during update

[zajca]

ještě bych tu napsal, že je to whole stack :D