Skip to content

ARROW-17892: [CI] Use Python 3.10 in AppVeyor build #14307

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jorisvandenbossche merged 12 commits into from
Nov 9, 2022
Merged

ARROW-17892: [CI] Use Python 3.10 in AppVeyor build #14307

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
a185a9d
Update AppVeyor build
AlenkaF Oct 4, 2022
70af643
Add changes to appveyor.yml and *setup.bat to unify Python versions
AlenkaF Oct 5, 2022
fd4feb6
Remove the use of clcache and add back python version to the creation…
AlenkaF Oct 6, 2022
8c2c3df
Try including ccache - simple version
AlenkaF Oct 10, 2022
a85d3a8
Testing changes in yml + retrieve CONDA_DLL_SEARCH_MODIFICATION_ENABLE
AlenkaF Oct 10, 2022
d125c85
Add a flag for ARROW_USE_SCCACHE
AlenkaF Oct 11, 2022
1b4253c
Test changes in yml - 2nd
AlenkaF Oct 11, 2022
f5e90ca
Test changes in yml - 3rd
AlenkaF Oct 11, 2022
b912231
Remove experiments with ccache and run the CI
AlenkaF Oct 25, 2022
556a32b
Remove CONDA_DLL_SEARCH_MODIFICATION_ENABLE
AlenkaF Oct 25, 2022
02ef33a
Remove (s)ccache cmake flags and add (s)ccache --show-config command
AlenkaF Oct 27, 2022
e540524
Add cache_dir and remove sccache/ccache command line options/option
AlenkaF Oct 27, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 3 additions & 10 deletions appveyor.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ only_commits:
- python/

cache:
- C:\Users\Appveyor\clcache1
- C:\Users\appveyor\AppData\Local\ccache

matrix:
fast_finish: true
Expand All @@ -39,21 +39,14 @@ environment:
APPVEYOR_SAVE_CACHE_ON_ERROR: true
MSVC_DEFAULT_OPTIONS: ON

# Change the clcache dir to reset caches everywhere when a setting
# is changed incompatibly (e.g. CLCACHE_COMPRESS).
CLCACHE_DIR: C:\Users\Appveyor\clcache1
CLCACHE_SERVER: 1
CLCACHE_COMPRESS: 1
CLCACHE_COMPRESSLEVEL: 6

ARCH: "64"
ARROW_BUILD_FLIGHT: "ON"
ARROW_BUILD_FLIGHT_SQL: "ON"
ARROW_BUILD_GANDIVA: "ON"
ARROW_GCS: "ON"
ARROW_S3: "ON"
GENERATOR: Ninja
PYTHON: "3.8"
PYTHON: "3.10"

before_build:
- call ci\appveyor-cpp-setup.bat
Expand All @@ -65,4 +58,4 @@ build_script:
test: off

after_build:
- clcache -s
- ccache -s
1 change: 0 additions & 1 deletion ci/appveyor-cpp-build.bat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,6 @@ cmake -G "%GENERATOR%" %CMAKE_ARGS% ^
-DARROW_WITH_ZLIB=ON ^
-DARROW_WITH_ZSTD=ON ^
-DCMAKE_BUILD_TYPE="Release" ^
-DCMAKE_CXX_COMPILER=clcache ^
-DCMAKE_CXX_FLAGS_RELEASE="/MD /Od /UNDEBUG" ^
-DCMAKE_CXX_STANDARD=17 ^
-DCMAKE_INSTALL_PREFIX=%CONDA_PREFIX%\Library ^
Expand Down
18 changes: 2 additions & 16 deletions ci/appveyor-cpp-setup.bat
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ conda info -a
@rem
@rem Install mamba to the base environment
@rem
conda install -q -y -c conda-forge mamba python=3.9 || exit /B
conda install -q -y -c conda-forge mamba python=%PYTHON% || exit /B

@rem Update for newer CA certificates
mamba update -q -y -c conda-forge --all || exit /B
Expand All @@ -55,10 +55,6 @@ mamba update -q -y -c conda-forge --all || exit /B
@rem Create conda environment
@rem

@rem Workaround for ARROW-17172
@rem This seems necessary for test_cython.py to succeed, otherwise
@rem the extension module being built would fail loading in a subprocess.
set CONDA_DLL_SEARCH_MODIFICATION_ENABLE=1
set CONDA_PACKAGES=

if "%ARROW_BUILD_GANDIVA%" == "ON" (
Expand All @@ -71,6 +67,7 @@ set CONDA_PACKAGES=%CONDA_PACKAGES% --file=ci\conda_env_cpp.txt
mamba create -n arrow -q -y -c conda-forge ^
--file=ci\conda_env_python.txt ^
%CONDA_PACKAGES% ^
"ccache" ^
"cmake" ^
"ninja" ^
"nomkl" ^
Expand All @@ -86,17 +83,6 @@ call "C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Auxiliary
set CC=cl.exe
set CXX=cl.exe

@rem
@rem Use clcache for faster builds
@rem

pip install -q git+https://github.com/Nuitka/clcache.git || exit /B
@rem Limit cache size to 500 MB
clcache -M 500000000
clcache -c
clcache -s
powershell.exe -Command "Start-Process clcache-server" || exit /B

@rem
@rem Download Minio somewhere on PATH, for unit tests
@rem
Expand Down