Skip to content

[Benchmarking][CI] Benchmarking has stopped working due to failing to build #45967

@raulcd

Description

@raulcd

Describe the bug, including details regarding any error messages, version, and platform.

Benchmarks have started failing again to build googletest-src now, see the error here:

+ cmake -Dabsl_SOURCE= -DARROW_ACERO=OFF -DARROW_AZURE=OFF -DARROW_BOOST_USE_SHARED=ON -DARROW_BUILD_BENCHMARKS_REFERENCE=ON -DARROW_BUILD_BENCHMARKS=ON -DARROW_BUILD_EXAMPLES=OFF -DARROW_BUILD_INTEGRATION=OFF -DARROW_BUILD_SHARED=ON -DARROW_BUILD_STATIC=ON -DARROW_BUILD_TESTS=OFF -DARROW_BUILD_UTILITIES=ON -DARROW_COMPUTE=ON -DARROW_CSV=ON -DARROW_CUDA=OFF -DARROW_CXXFLAGS= -DARROW_CXX_FLAGS_DEBUG= -DARROW_CXX_FLAGS_RELEASE= -DARROW_CXX_FLAGS_RELWITHDEBINFO= -DARROW_C_FLAGS_DEBUG= -DARROW_C_FLAGS_RELEASE= -DARROW_C_FLAGS_RELWITHDEBINFO= -DARROW_DATASET=ON -DARROW_DEPENDENCY_SOURCE=AUTO -DARROW_DEPENDENCY_USE_SHARED=ON -DARROW_ENABLE_THREADING=ON -DARROW_ENABLE_TIMING_TESTS=ON -DARROW_EXTRA_ERROR_CONTEXT=OFF -DARROW_FILESYSTEM=ON -DARROW_FLIGHT=OFF -DARROW_FLIGHT_SQL=OFF -DARROW_FUZZING=OFF '-DARROW_GANDIVA_PC_CXX_FLAGS=-isystem;/var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/../lib/gcc/x86_64-conda-linux-gnu/13.3.0/include/c++;-isystem;/var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/../lib/gcc/x86_64-conda-linux-gnu/13.3.0/include/c++/x86_64-conda-linux-gnu;-isystem;/var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/../lib/gcc/x86_64-conda-linux-gnu/13.3.0/include/c++/backward;-isystem;/var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/../lib/gcc/x86_64-conda-linux-gnu/13.3.0/include;-isystem;/var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/../lib/gcc/x86_64-conda-linux-gnu/13.3.0/include-fixed;-isystem;/var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/../x86_64-conda-linux-gnu/sysroot/usr/include;' -DARROW_GANDIVA=OFF -DARROW_GCS=OFF -DARROW_HDFS=ON -DARROW_INSTALL_NAME_RPATH=ON -DARROW_JEMALLOC=OFF -DARROW_JSON=ON -DARROW_LARGE_MEMORY_TESTS=OFF -DARROW_MIMALLOC=ON -DARROW_ORC=ON -DARROW_PARQUET=ON -DARROW_RUNTIME_SIMD_LEVEL=MAX -DARROW_S3=ON -DARROW_SIMD_LEVEL=DEFAULT -DARROW_SKYHOOK=OFF -DARROW_SUBSTRAIT=OFF -DARROW_TEST_LINKAGE=shared -DARROW_TEST_MEMCHECK=OFF -DARROW_USE_ASAN=OFF -DARROW_USE_CCACHE=ON -DARROW_USE_GLOG=OFF -DARROW_USE_LD_GOLD=OFF -DARROW_USE_LLD=OFF -DARROW_USE_MOLD=OFF -DARROW_USE_PRECOMPILED_HEADERS=OFF -DARROW_USE_STATIC_CRT=OFF -DARROW_USE_TSAN=OFF -DARROW_USE_UBSAN=OFF -DARROW_VERBOSE_THIRDPARTY_BUILD=OFF -DARROW_WITH_BROTLI=ON -DARROW_WITH_BZ2=ON -DARROW_WITH_LZ4=ON -DARROW_WITH_OPENTELEMETRY=OFF -DARROW_WITH_MUSL=OFF -DARROW_WITH_SNAPPY=ON -DARROW_WITH_UTF8PROC=ON -DARROW_WITH_ZLIB=ON -DARROW_WITH_ZSTD=ON -DAWSSDK_SOURCE= -DAzure_SOURCE= -Dbenchmark_SOURCE= -DBOOST_SOURCE= -DBrotli_SOURCE= -DBUILD_WARNING_LEVEL=CHECKIN -Dc-ares_SOURCE= -DCMAKE_BUILD_TYPE=release -DCMAKE_VERBOSE_MAKEFILE=OFF '-DCMAKE_C_FLAGS=-march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /var/lib/buildkite-agent/.conda/envs/arrow-commit/include' '-DCMAKE_CXX_FLAGS=-fvisibility-inlines-hidden -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /var/lib/buildkite-agent/.conda/envs/arrow-commit/include' -DCMAKE_CXX_STANDARD=17 -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_INSTALL_PREFIX=/var/lib/buildkite-agent/.conda/envs/arrow-commit -DCMAKE_UNITY_BUILD=OFF -DCUDAToolkit_ROOT= -Dgflags_SOURCE= -Dgoogle_cloud_cpp_storage_SOURCE= -DgRPC_SOURCE= -DGTest_SOURCE=BUNDLED -Dlz4_SOURCE= -Dopentelemetry-cpp_SOURCE= -DORC_SOURCE=BUNDLED -DPARQUET_BUILD_EXAMPLES=ON -DPARQUET_BUILD_EXECUTABLES=ON -DPARQUET_REQUIRE_ENCRYPTION=ON -DProtobuf_SOURCE= -DRapidJSON_SOURCE= -Dre2_SOURCE= -DSnappy_SOURCE= -DThrift_SOURCE= -Dutf8proc_SOURCE= -Dzstd_SOURCE= -Dxsimd_SOURCE= -G Ninja -DCMAKE_AR=/var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/x86_64-conda-linux-gnu-ar -DCMAKE_RANLIB=/var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/x86_64-conda-linux-gnu-ranlib /var/lib/buildkite-agent/builds/amd64-c6a-4xlarge-linux-i-07e17d445aa24575b-1/apache-arrow/arrow-bci-benchmark-on-amd64-c6a-4xlarge-linux/arrow/cpp
CMake Warning (dev) at cmake_modules/ThirdpartyToolchain.cmake:291 (find_package):
  Policy CMP0167 is not set: The FindBoost module is removed.  Run "cmake
  --help-policy CMP0167" for policy details.  Use the cmake_policy command to
  set the policy and suppress this warning.
Call Stack (most recent call first):
  cmake_modules/ThirdpartyToolchain.cmake:1287 (resolve_dependency)
  CMakeLists.txt:547 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.
CMake Error at /tmp/6e2a363b-3b45-42aa-8a86-247f0162991a/cpp/_deps/googletest-src/CMakeLists.txt:4 (cmake_minimum_required):
  Compatibility with CMake < 3.5 has been removed from CMake.
  Update the VERSION argument <min> value.  Or, use the <min>...<max> syntax
  to tell CMake that the project requires at least <min> but has been updated
  to work with policies introduced by <max> or earlier.
  Or, add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to try configuring anyway.

I am unsure if this is the error or there are previous errors because it seems to fail to configure, see last log line here:

-- Found Boost: /var/lib/buildkite-agent/.conda/envs/arrow-commit/lib/cmake/Boost-1.85.0/BoostConfig.cmake (found suitable version "1.85.0", minimum required is "1.58") found components: filesystem system missing components: process
-- Boost include dir: /var/lib/buildkite-agent/.conda/envs/arrow-commit/include
-- Providing CMake module for FindSnappyAlt as part of Arrow CMake package
-- pkg-config package for snappy that is used by arrow for static link isn't found
-- Checking for modules 'libbrotlicommon;libbrotlienc;libbrotlidec'
--   Found libbrotlicommon, version 1.1.0
--   Found libbrotlienc, version 1.1.0
--   Found libbrotlidec, version 1.1.0
-- Found BrotliAlt: /var/lib/buildkite-agent/.conda/envs/arrow-commit/lib/libbrotlicommon.so
-- Providing CMake module for FindBrotliAlt as part of Arrow CMake package
-- Using pkg-config package for libbrotlidec that is used by arrow for static link
-- Using pkg-config package for libbrotlienc that is used by arrow for static link
-- Found OpenSSL: /var/lib/buildkite-agent/.conda/envs/arrow-commit/lib/libcrypto.so (found suitable version "3.4.1", minimum required is "1.0.2")
-- Providing CMake module for FindOpenSSLAlt as part of Arrow CMake package
-- Found OpenSSL Crypto Library: /var/lib/buildkite-agent/.conda/envs/arrow-commit/lib/libcrypto.so
-- Building with OpenSSL (Version: 3.4.1) support
-- Found thrift: /var/lib/buildkite-agent/.conda/envs/arrow-commit
-- Found ZLIB: /var/lib/buildkite-agent/.conda/envs/arrow-commit/lib/libz.so (found version "1.3.1")
-- Found OpenSSL: /var/lib/buildkite-agent/.conda/envs/arrow-commit/lib/libcrypto.so (found version "3.4.1")
-- Found libevent: /var/lib/buildkite-agent/.conda/envs/arrow-commit/lib/libevent.so
-- Providing CMake module for FindThriftAlt as part of Parquet CMake package
-- Using pkg-config package for thrift that is used by parquet for static link
-- Could NOT find protobuf (missing: protobuf_DIR)
-- Found Protobuf: /var/lib/buildkite-agent/.conda/envs/arrow-commit/lib/libprotobuf.so;-pthread (found version "3.21.12")
-- Providing CMake module for FindProtobufAlt as part of Arrow CMake package
-- Using pkg-config package for protobuf that is used by arrow for static link
-- Found protoc: /var/lib/buildkite-agent/.conda/envs/arrow-commit/bin/protoc
-- Building (vendored) mimalloc from source
-- Building gtest from source
-- Configuring incomplete, errors occurred!

Log of the failure can be found here:
https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-amd64-c6a-4xlarge-linux/builds/950#0195dac3-cccd-4839-a193-2b23720df4ee
More failures can be found here:
https://buildkite.com/apache-arrow
The last commit benchmarked is this one: f4b7a4e

Component(s)

Continuous Integration, Benchmarking

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions