Skip to content

Conversation

@hiroyuki-sato
Copy link
Collaborator

@hiroyuki-sato hiroyuki-sato commented May 19, 2025

Rationale for this change

We are trying to implement shellcheck on all sh files in #44748.

What changes are included in this PR?

SC2086 check requires quoting like ${url} -> "${url}".

Are these changes tested?

Yes.

Are there any user-facing changes?

No.

@github-actions
Copy link

⚠️ GitHub issue #46496 has been automatically assigned in GitHub to PR creator.

@github-actions github-actions bot added the awaiting review Awaiting review label May 19, 2025
@hiroyuki-sato
Copy link
Collaborator Author

hiroyuki-sato commented May 19, 2025

I modified many files at once. But, all of changes are ${var} -> "${var}". So, I believe review is not so hard.

Please let me know, it would be better to split this into multiple PRs.
(IMO, It is a little tedious to create PR for one by one)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you remove this file in a separated PR?

We moved the Java implementation to apache/arrow-java.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK. Should I also remove ci/scripts/rust_build.sh too?

diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml
index fe178e069..3ef23a08e 100644
--- a/.pre-commit-config.yaml
+++ b/.pre-commit-config.yaml
@@ -196,13 +196,31 @@ repos:
           ?^ci/scripts/c_glib_build\.sh$|
           ?^ci/scripts/c_glib_test\.sh$|
           ?^ci/scripts/conan_setup\.sh$|
+          ?^ci/scripts/csharp_build\.sh$|
+          ?^ci/scripts/csharp_pack\.sh$|
           ?^ci/scripts/download_tz_database\.sh$|
           ?^ci/scripts/install_azurite\.sh$|
           ?^ci/scripts/install_ccache\.sh$|
           ?^ci/scripts/install_ceph\.sh$|
+          ?^ci/scripts/install_chromedriver\.sh$|
+          ?^ci/scripts/install_cmake\.sh$|
+          ?^ci/scripts/install_emscripten\.sh$|
+          ?^ci/scripts/install_iwyu\.sh$|
+          ?^ci/scripts/install_ninja\.sh$|
+          ?^ci/scripts/install_numpy\.sh$|
+          ?^ci/scripts/install_pandas\.sh$|
+          ?^ci/scripts/install_python\.sh$|
           ?^ci/scripts/install_spark\.sh$|
+          ?^ci/scripts/install_vcpkg\.sh$|
           ?^ci/scripts/integration_dask\.sh$|
+          ?^ci/scripts/java_full_build\.sh$|
+          ?^ci/scripts/matlab_build\.sh$|
+          ?^ci/scripts/msys2_system_clean\.sh$|
           ?^ci/scripts/msys2_system_upgrade\.sh$|
+          ?^ci/scripts/python_sdist_build\.sh$|
+          ?^ci/scripts/release_test\.sh$|
+          ?^ci/scripts/ruby_test\.sh$|
+          ?^ci/scripts/rust_build\.sh$|
           ?^ci/scripts/util_free_space\.sh$|
           ?^cpp/build-support/build-lz4-lib\.sh$|
           ?^cpp/build-support/build-zstd-lib\.sh$|

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's used here:

${arrow_dir}/ci/scripts/rust_build.sh ${arrow_dir} ${build_dir}

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Created #46502

@github-actions github-actions bot added awaiting changes Awaiting changes and removed awaiting review Awaiting review labels May 19, 2025
@kou
Copy link
Member

kou commented May 19, 2025

@github-actions crossbow submit -g python

@kou
Copy link
Member

kou commented May 19, 2025

Could you open a new issue for MATLAB CI failures?

@github-actions
Copy link

Revision: f1917a8

Submitted crossbow builds: ursacomputing/crossbow @ actions-c037629e6f

Task Status
example-python-minimal-build-fedora-conda GitHub Actions
example-python-minimal-build-ubuntu-venv GitHub Actions
test-conda-python-3.10 GitHub Actions
test-conda-python-3.10-hdfs-2.9.2 GitHub Actions
test-conda-python-3.10-hdfs-3.2.1 GitHub Actions
test-conda-python-3.10-pandas-latest-numpy-latest GitHub Actions
test-conda-python-3.11 GitHub Actions
test-conda-python-3.11-dask-latest GitHub Actions
test-conda-python-3.11-dask-upstream_devel GitHub Actions
test-conda-python-3.11-hypothesis GitHub Actions
test-conda-python-3.11-pandas-latest-numpy-1.26 GitHub Actions
test-conda-python-3.11-pandas-latest-numpy-latest GitHub Actions
test-conda-python-3.11-pandas-nightly-numpy-nightly GitHub Actions
test-conda-python-3.11-pandas-upstream_devel-numpy-nightly GitHub Actions
test-conda-python-3.11-spark-master GitHub Actions
test-conda-python-3.12 GitHub Actions
test-conda-python-3.12-cpython-debug GitHub Actions
test-conda-python-3.13 GitHub Actions
test-conda-python-3.9 GitHub Actions
test-conda-python-3.9-pandas-1.1.3-numpy-1.19.5 GitHub Actions
test-conda-python-emscripten GitHub Actions
test-cuda-python-ubuntu-22.04-cuda-11.7.1 GitHub Actions
test-debian-12-python-3-amd64 GitHub Actions
test-debian-12-python-3-i386 GitHub Actions
test-fedora-39-python-3 GitHub Actions
test-ubuntu-22.04-python-3 GitHub Actions
test-ubuntu-22.04-python-313-freethreading GitHub Actions
test-ubuntu-24.04-python-3 GitHub Actions

@hiroyuki-sato
Copy link
Collaborator Author

I created #46498 for MATLAB CI Failure.

@github-actions github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels May 19, 2025
@hiroyuki-sato
Copy link
Collaborator Author

It seems that the following error are know issues.

Rest of two are the same error.

  • example-python-minimal-build-fedora-conda
  • example-python-minimal-build-ubuntu-venv

https://github.com/ursacomputing/crossbow/actions/runs/15107317228/job/42458657050#step:3:13178
https://github.com/ursacomputing/crossbow/actions/runs/15107317390/job/42458658267#step:3:15548

E                   ImportError: Pandas requires version '10.0.1' or newer of 'pyarrow' (version '0.1.dev17552+gf1917a8' currently installed).

@hiroyuki-sato
Copy link
Collaborator Author

@github-actions crossbow submit example-python-minimal-build-fedora-conda

@hiroyuki-sato
Copy link
Collaborator Author

hiroyuki-sato commented May 20, 2025

It seems that I don't have permission crossbow. It worked.

@github-actions
Copy link

Revision: 709f074

Submitted crossbow builds: ursacomputing/crossbow @ actions-0b8afc1ec8

Task Status
example-python-minimal-build-fedora-conda GitHub Actions

@raulcd
Copy link
Member

raulcd commented May 20, 2025

The failure on the example-python-minimal-* is a known issue if your fork is missing some dev tags, see:

You can either push the dev tags from the apache/arrow repo to your fork or ignore those failures.

We should fix the issue I've shared as this is recurring for new contributions :)

@hiroyuki-sato
Copy link
Collaborator Author

@raulcd Thanks! I pushed tag to my repository.
#44720 (comment)

@raulcd
Copy link
Member

raulcd commented May 20, 2025

@github-actions crossbow submit example-python-minimal-build-fedora-conda

@github-actions
Copy link

Revision: 709f074

Submitted crossbow builds: ursacomputing/crossbow @ actions-33609c0757

Task Status
example-python-minimal-build-fedora-conda GitHub Actions

@hiroyuki-sato
Copy link
Collaborator Author

@kou crossbow failure are known issues. I think crossbow passed. Please take a look when you get a chance.

Copy link
Member

@kou kou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@kou kou merged commit ddfa762 into apache:main May 21, 2025
31 of 36 checks passed
@kou kou removed the awaiting change review Awaiting change review label May 21, 2025
@github-actions github-actions bot added the awaiting merge Awaiting merge label May 21, 2025
@conbench-apache-arrow
Copy link

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit ddfa762.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 1 possible false positive for unstable benchmarks that are known to sometimes produce them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

awaiting merge Awaiting merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants