[C++] Bump versions of bundled dependencies

[asfimport]

We should bump bundled third-party dependencies to newer versions as far as possible (some may not be compatible, e.g. the AWS SDK).

Reporter: Antoine Pitrou / @pitrou
Assignee: Benson Muite / @bkmgit

Related issues:

• [C++] Consolidate thirdparty bundle URLs, version bumping logic, etc (is related to)

PRs and other links:

• GitHub Pull Request #11340
• GitHub Pull Request #11494

_{Note: This issue was originally created as ARROW-14229. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
cc @bkmgit

[asfimport]

Benson Muite / @bkmgit:
Possible updates are:

• xsimd https://github.com/xtensor-stack/xsimd

• Apache Thrift https://thrift.apache.org/download

• Google Snappy https://github.com/google/snappy/releases

• Google RE2 https://github.com/google/re2

• RAPIDJSON https://github.com/Tencent/rapidjson - not updated, no releases in some time

• Protobuf https://github.com/protocolbuffers/protobuf

• GRPC https://github.com/grpc/grpc

• GLOG https://github.com/google/glog

• C-ARES https://c-ares.org/

• BOOST https://www.boost.org/

• AWS SDK https://github.com/aws/aws-sdk-cpp

• AWS CHECKSUMS https://github.com/awslabs/aws-checksums

   

[asfimport]

Benson Muite / @bkmgit:
Copies of new versions need to be uploaded to https://github.com/ursa-labs/thirdparty/releases/

https://github.com/googleapis/google-cloud-cpp/
https://github.com/nlohmann/json/
https://github.com/google/crc32c
 are missing from https://github.com/ursa-labs/thirdparty/releases/

[asfimport]

Antoine Pitrou / @pitrou:
cc @nealrichardson

[asfimport]

Neal Richardson / @nealrichardson:
Should be yes, but it's just a mirror so it's not blocking this upgrade, correct?

[asfimport]

Antoine Pitrou / @pitrou:
Hmm, I cannot reproduce the issue with recent AWS SDK versions anymore, at least with the conda packages, so perhaps it can be bumped as well.

[asfimport]

Alessandro Molina / @amol-:
Would it be reasonable to defer this one after the release? I think it would be good to have a bit more time to test the updated dependencies instead of pushing them out just a few days before a release

[asfimport]

Antoine Pitrou / @pitrou:
Indeed, I think it's more reasonable to defer this since we aim for cutting a first RC in a couple days.

[asfimport]

Benson Muite / @bkmgit:
Most recent version of AWS SDK, 1.9.123 does not build correctly for all other test builds.

[asfimport]

Benson Muite / @bkmgit:
One needs to add at least AWS-CRT-CPP which also replaces some of the other AWS packages and will continue to grow.

[asfimport]

Benson Muite / @bkmgit:
Latest release of Abseil ( LTS 20210324.2) seems like it might need C++17 abseil/abseil-cpp#819  to avoid errors such as:

 
/usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::numbers_internal::safe_strtou64_base(absl::lts_20210324::string_view, unsigned long\*, int)'   /usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::numbers_internal::safe_strto64_base(absl::lts_20210324::string_view, long*, int)'

[asfimport]

Benson Muite / @bkmgit:
C+17 build seems to want to use abseil compiled with C+11:

 
/usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::numbers_internal::safe_strtou64_base(absl::lts_20210324::string_view, unsigned long\*, int)'   /usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::numbers_internal::safe_strto64_base(absl::lts_20210324::string_view, long*, int)'
 
/usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::numbers_internal::safe_strto32_base(absl::lts_20210324::string_view, int\*, int)'   /usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::numbers_internal::safe_strtou32_base(absl::lts_20210324::string_view, unsigned int*, int)'
 
/usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::optional_internal::throw_bad_optional_access()'   /usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::ByChar::Find(absl::lts_20210324::string_view, unsigned long) const'
 
/usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::ParseTime(absl::lts_20210324::string_view, absl::lts_20210324::string_view, absl::lts_20210324::Time\*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >\*)'   /usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::ParseCivilTime(absl::lts_20210324::string_view, absl::lts_20210324::time_internal::cctz::detail::civil_timeabsl::lts_20210324::time_internal::day_tag*)'
 
/usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::string_view::find(absl::lts_20210324::string_view, unsigned long) const'   /usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to absl::lts_20210324::strings_internal::CatPiecesabi:cxx11'
 
/usr/bin/ld: debug/libarrow.so.600.0.0: undefined reference to `absl::lts_20210324::FormatTime[abi:cxx11](absl::lts_20210324::string_view, absl::lts_20210324::Time, absl::lts_20210324::TimeZone)'
 
collect2: error: ld returned 1 exit status

[asfimport]

Benson Muite / @bkmgit:
It may be better to update some of the dependencies in separate issues since they will each require some code changes due to interface changes.

[asfimport]

Antoine Pitrou / @pitrou:
Issue resolved by pull request 11494
#11494