[BEAM-11205] Upgrade Libraries BOM dependencies to 24.3.0 #16850

benEng · 2022-02-14T20:28:42Z

Upgrading Google Cloud Libraries BOM to the latest version 24.3.0 and associated dependencies to the compatible versions.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

Choose reviewer(s) and mention them in a comment (R: @username).
Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
Update CHANGES.md with noteworthy changes.
If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

`ValidatesRunner` compliance status (on master branch)

Lang	ULR	Twister2
Go	---	---
Java
Python	---	---
XLang		---

Examples testing status on various runners

Lang	ULR	Dataflow	Flink	Samza	Spark	Twister2
Go	---	---	---	---	---	---	---
Java	---		---	---	---	---	---
Python	---	---	---	---	---	---	---
XLang	---	---	---	---	---	---	---

Post-Commit SDK/Transform Integration Tests Status (on master branch)

Go	Java	Python

Pre-Commit Tests Status (on master branch)

---	Java	Python	Go	Website	Whitespace	Typescript
Non-portable
Portable	---			---	---	---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

codecov · 2022-02-14T21:27:44Z

Codecov Report

Merging #16850 (fd16c0e) into master (6c04c3c) will increase coverage by 36.67%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master   #16850       +/-   ##
===========================================
+ Coverage   46.89%   83.56%   +36.67%     
===========================================
  Files         204      453      +249     
  Lines       20122    62533    +42411     
===========================================
+ Hits         9436    52256    +42820     
- Misses       9686    10277      +591     
+ Partials     1000        0     -1000

Flag	Coverage Δ
python	`83.61% <ø> (?)`

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
sdks/go/pkg/beam/core/runtime/graphx/cogbk.go
sdks/go/pkg/beam/pardo.go
sdks/go/pkg/beam/core/typex/fulltype.go
sdks/go/pkg/beam/core/runtime/exec/hash.go
sdks/go/pkg/beam/core/runtime/harness/harness.go
sdks/go/pkg/beam/core/util/reflectx/types.go
sdks/go/pkg/beam/runner.go
sdks/go/pkg/beam/io/filesystem/gcs/gcs.go
sdks/go/pkg/beam/artifact/materialize.go
sdks/go/pkg/beam/core/runtime/exec/datasource.go
... and 647 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6c04c3c...fd16c0e. Read the comment docs.

benEng · 2022-02-16T18:51:41Z

Run Java PostCommit

benEng · 2022-02-16T18:51:54Z

Run PostCommit_Java_Hadoop_Versions

benEng · 2022-02-16T18:52:38Z

Run Dataflow ValidatesRunner

benEng · 2022-02-22T00:07:32Z

Hi @suztomo, could you help me to review this?
I have updated the dependencies listed in https://storage.googleapis.com/cloud-opensource-java-dashboard/com.google.cloud/libraries-bom/24.3.0/artifact_details.html and I ran the Linkage Check but it is having new errors https://gist.github.com/benWize/0edd56b32d9b1e7b22d4cd9c231887c3, not sure how to proceed with those.

suztomo · 2022-02-22T14:45:22Z

buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy

    def spotbugs_version = "4.0.6"
    def testcontainers_version = "1.16.3"
-    def arrow_version = "5.0.0"
+    def arrow_version = "7.0.0"


I don't think we touch this version when we upgrade the Libraries BOM. What do you need from this?

When I updated the netty_version

beam/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy

Line 491 in 827d44d

def netty_version = "4.1.72.Final"

it shows that arrow_vector uses netty-common 4.1.48.Final, so I updated it to match both versions.

Nice. Then I would say we don't need to touch the netty version. Google Cloud libraries' netty dependencies come from io.grpc:grpc-netty-shaded.

it shows that arrow_vector uses netty-common 4.1.48.Final

I'm curious. What was "it"? Where did you see the advice?

On linkage checker results:
org.graalvm.nativeimage:svm:19.3.6 is at: org.apache.beam:beam-sdks-java-io-google-cloud-platform:jar:2.38.0-SNAPSHOT / io.netty:netty-handler:4.1.72.Final (compile) / io.netty:netty-common:4.1.72.Final (compile) / org.graalvm.nativeimage:svm:19.3.6 (provided) and 93 other dependency paths. com.oracle.substratevm:svm:19.0.0 is at: org.apache.beam:beam-sdks-java-io-google-cloud-platform:jar:2.38.0-SNAPSHOT / org.apache.arrow:arrow-vector:5.0.0 (compile) / io.netty:netty-common:4.1.48.Final (compile) / com.oracle.substratevm:svm:19.0.0 (provided) and 1 dependency path.

I rollbacked the version changes for netty_version and arrow_version

suztomo · 2022-02-22T14:45:54Z

buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy

    // Maven artifacts.
    def activemq_version = "5.14.5"
-    def autovalue_version = "1.8.2"
+    def autovalue_version = "1.9"


AutoValue is 1.9. Good.

https://storage.googleapis.com/cloud-opensource-java-dashboard/com.google.cloud/libraries-bom/24.3.0/artifact_details.html

suztomo · 2022-02-22T14:46:30Z

buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy

    def powermock_version = "2.0.9"
    // Try to keep protobuf_version consistent with the protobuf version in google_cloud_platform_libraries_bom
-    def protobuf_version = "3.19.2"
+    def protobuf_version = "3.19.3"


Protobuf 3.19.3. Good. https://storage.googleapis.com/cloud-opensource-java-dashboard/com.google.cloud/libraries-bom/24.3.0/artifact_details.html

suztomo · 2022-02-22T14:47:30Z

buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy

    def kafka_version = "2.4.1"
    def nemo_version = "0.1"
-    def netty_version = "4.1.52.Final"
+    def netty_version = "4.1.72.Final"


As Google Cloud libraries' netty dependencies come from grpc-netty-shaded, this change shouldn't be needed (but I guess this should be no harm)

suztomo · 2022-02-22T14:54:08Z

And thank you for checking the dependencies with Linkage Checker.

For the linkage errors you pasted https://gist.github.com/benWize/0edd56b32d9b1e7b22d4cd9c231887c3. These are false positives.

com.aayushatharva.brotli4j and com.github.luben.zstd are compression algorithms optionally used by Netty. When Netty users need them, they include the libraries in the class path; otherwise, the classes are not needed.

Linkage Errors from optional dependencies

Class com.aayushatharva.brotli4j.decoder.DecoderJNI$Status is not found;
  referenced by 2 class files
    io.grpc.netty.shaded.io.netty.handler.codec.compression.BrotliDecoder (io.grpc:grpc-netty-shaded:1.44.1)
    io.netty.handler.codec.compression.BrotliDecoder (io.netty:netty-codec:4.1.72.Final)
  Cause:
    Unknown
    The valid symbol is in com.aayushatharva.brotli4j:brotli4j:jar:1.6.0 at org.apache.beam:beam-sdks-java-io-google-cloud-platform:jar:2.38.0-SNAPSHOT / io.netty:netty-handler:4.1.72.Final (compile) / io.netty:netty-codec:4.1.72.Final (compile) / com.aayushatharva.brotli4j:brotli4j:1.6.0 (compile, optional) but it was not selected because the path contains an optional dependency

(and others)

They are shown there because optional dependencies are not by default included. They are false positives.

Linkage Errors from GraalVM (or svm)

Class org.graalvm.nativeimage.hosted.Feature$IsInConfigurationAccess is not found;
  referenced by 10 class files
    com.oracle.svm.core.jdk8.LocalizationFeatureJDK8 (org.graalvm.nativeimage:svm:19.3.6)
    com.oracle.svm.core.graal.snippets.PosixAArch64VaListSnippetsFeature (org.graalvm.nativeimage:svm:19.3.6)
    com.oracle.svm.hosted.SecurityServicesFeature (org.graalvm.nativeimage:svm:19.3.6)
    com.oracle.svm.hosted.FallbackFeature (org.graalvm.nativeimage:svm:19.3.6)
    com.oracle.svm.graal.AMD64ArrayIndexOfForeignCallsFeature (org.graalvm.nativeimage:svm:19.3.6)
...

These are errors coming from GraalVM classes. Because the JVMs other than GraalVM do not have the classes, they are false positives.

benEng · 2022-02-22T23:00:48Z

Run SQL PreCommit

suztomo · 2022-02-23T00:33:06Z

Run Java PostCommit

suztomo · 2022-02-23T00:33:16Z

Run PostCommit_Java_Dataflow

suztomo · 2022-02-23T00:33:22Z

Run PostCommit_Java_DataflowV2

suztomo · 2022-02-23T00:33:29Z

Run Dataflow ValidatesRunner

suztomo · 2022-02-23T00:33:33Z

Run Spark ValidatesRunner

suztomo · 2022-02-23T00:34:24Z

Where is Jenkins...? (searching beam-dev mailing list)

-> https://lists.apache.org/thread/orjmfx96xx4zkolms93395dgfq7n7hg5 says "Jenkins CI has availability issues, please don't merge PRs that didn't run the tests."

suztomo · 2022-02-23T00:35:50Z

retest this please

benEng · 2022-02-23T16:07:23Z

retest this please

benEng · 2022-02-23T19:31:50Z

retest this please

benEng · 2022-02-23T20:38:53Z

Run Portable_Python PreCommit

benEng · 2022-02-23T20:39:13Z

Run Java_PVR_Flink_Batch PreCommit

benEng · 2022-02-23T20:40:31Z

Run Java_Examples_Dataflow_Java17 PreCommit

suztomo · 2022-02-23T20:56:30Z

Run Java PreCommit

benEng · 2022-02-23T21:34:10Z

Run PostCommit_Java_DataflowV2

benEng · 2022-02-23T21:34:51Z

Run Java PostCommit

benEng · 2022-02-23T21:35:37Z

Run Dataflow ValidatesRunner

benEng · 2022-02-23T23:58:11Z

Run Spark ValidatesRunner

benEng · 2022-02-24T15:40:18Z

Run Java_PVR_Flink_Batch PreCommit

benEng · 2022-02-24T17:49:58Z

Google Cloud Dataflow Runner ValidatesRunner Tests failure seems related to https://issues.apache.org/jira/browse/BEAM-13952

kileys · 2022-02-25T19:54:40Z

Run Dataflow ValidatesRunner

suztomo · 2022-03-01T18:35:57Z

@benWize Thank you for picking up this upgrade and following up the checks.

benEng · 2022-03-01T18:43:43Z

Thank you, @suztomo!

…ependencies to 24.3.0 * Update GCP Libraries BOM version to 24.3.0 * Update associated dependencies

…r transaction boundaries and transaction ID ordering. * Added integration test for transaction boundaries and transaction ID ordering. Made small fixes in ordered by key integration test. * [BEAM-9150] Fix beam_PostRelease_Python_Candidate (python RC validation scripts) (#16955) * Use default context output rather than outputWithTimestamp for ElasticsearchIO * Palo Alto case study - fix link * [BEAM-12777] Removed current docs version redirect * Merge pull request #16850: [BEAM-11205] Upgrade Libraries BOM dependencies to 24.3.0 * Update GCP Libraries BOM version to 24.3.0 * Update associated dependencies * Merge pull request #16484 from [BEAM-13633] [Playground] Implement method to get a default example for each SDKs * Implement method to get a default example for each SDKs * Add error handling * Added saving of precompiled objects catalog to cache at the server startup * Added caching of the catalog only in case of unspecified SDK * Update regarding comments * Update regarding comments * Simplified logging regarding comment * Get defaultExamplePath from the corresponding config * Refactoring code * Add the `link` field to response * Remove gjson; Resolve conflicts; * Refactoring code * Getting default precompiled object from cache * Refactoring code * Added saving of precompiled objects catalog to cache at the server startup * Added caching of the catalog only in case of unspecified SDK * Update regarding comments * Update regarding comments * Simplified logging regarding comment * Updates regarding comments * Update for environment_service_test.go * Get default example from catalog * GetCatalogFromCacheOrStorage method * Update licenses * Update licenses; Resolve conflicts; * [BEAM-13633][Playground] Change saving default precompiled objects to the cache * [BEAM-13633][Playground] Change logic of saving and receiving info about default precompiled objects * [BEAM-13633][Playground] Separate for each sdk * [BEAM-13633][Playground] regenerate proto files * Add code of the default example to response * Revert "Add code of the default example to response" This reverts commit da6baa0. * Refactoring code * Refactoring code; Add test; * Edit commentaries * Refactoring code * Add bucket name to methods Co-authored-by: Artur Khanin <artur.khanin@akvelon.com> Co-authored-by: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com> Co-authored-by: Pavel Avilov <pavel.avilov> * Add 2022 events blog post (#16975) * Clean up Go formatter suggestions (#16973) * [BEAM-14012] Add go fmt to Github Actions (#16978) * [BEAM-13911] Add basic tests to Go direct runner. (#16979) * [BEAM-13960] Add support for more types when converting from between row and proto (#16875) * Adding schema support. * Addressing feedback. * Bump org.mongodb:mongo-java-driver to 3.12.10 * [BEAM-13973] Link Dataproc Flink master URLs to the InteractiveRunner when FlinkRunner is used (#16904) * [BEAM-13925] Turn pr bot on for go prs (#16984) * [BEAM-13964] Bump kotlin to 1.6.x (#16882) * [BEAM-13964] Bump kotlin to 1.6.x * [BEAM-13964] Bump kotlin to 1.6.x * [BEAM-13964] fix warnings in Kotlin compilation * Skipping flaky sad-path tests for Spanner changestreams * Merge pull request #16906: [BEAM-13974] Handle idle Storage Api streams * Merge pull request #16562 from [BEAM-13051][D] Enable pylint warnings (no-name-in-module/no-value-for-parameter) * [BEAM-13051] Pylint no-name-in-module and no-value-for-parameter warnings enabled * [BEAM-13051] Fixed no-value-for-parameter warning for missing default values * [BEAM-13051] Fixed parameters warnings * [BEAM-13925] A couple small pr-bot bug fixes (#16996) * [BEAM-14029] Add getter, setter for target maven repo (#16995) * [BEAM-13903] Improve coverage of metricsx package (#16994) * [BEAM-13892] Improve coverage of avroio package (#16990) * [adhoc] Prepare aws2 ClientConfiguration for json serialization and cleanup AWS Module (#16894) * [adhoc] Prepare aws2 ClientConfiguration and related classes for json serialization and cleanup AWS Module * Merge pull request #16879 from [BEAM-12164] Add javadocs to SpannerConfig * Add tests and config for retry * lint * add tests * lint * Delete tests not passing * Rebase on apache beam master * review changes * review changes * add javadocs to SpannerConfig * revert * add full stops * [Cleanup] Update pre-v2 go package references (#17002) * [BEAM-13885] Add unit tests to window package (#16971) * Merge pull request #16891 from [BEAM-13872] [Playground] Increase test coverage for the code_processing package * Increase test coverage for the code_processing package * Refactoring code * Add test cases with mock cache * Add test for processCompileSuccess method * Update test names * Refactoring code * Merge pull request #16912 from [BEAM-13878] [Playground] Increase test coverage for the fs_tool package * Increase test coverage for the fs_tool package * Rename folder * Remove useless variable * Update test names * Merge pull request #16946 from [BEAM-13873] [Playground] Increase test coverage for the environment package * Increase test coverage for the environment package * Update test names * Refactoring code * Add bucket name to method * [BEAM-13999] playground - support vertical orientation for graph * [BEAM-13951] Update mass_comment.py list of Run commands (#16889) * BEAM-13951: Sort run command list * BEAM-13951: Update list * fixup! BEAM-13951: Update list * [BEAM-10652] Allow Clustering without Partition in BigQuery (#16578) * [BEAM-10652] removed check that blocked clustering without partitioning * [BEAM-10652] allow clustering without requiring partition * newline * added needed null * remove testClusteringThrowsWithoutPartitioning * update clustering * formatting * now compiles * passes spotless * update doc * focus on single test * spotless * run all ITs * spotless * testing with time partitioning * checking * set clustering independant of partitioning * remove timepart from it * spotless * removed test * added TODO * removed block of unneded code/comment * remove override to v3 coder * Spotless cleanup * re-add override to v3 coder * spotless * adding checksum ( wrong value ) * added needed query var * use tableName as var * DATASET NAME * project name in query * update query * change tests * remove unneeded imports * remove rest of forgotten * add rows * 16000 bytes * bigint * streaming test * spotless * methods * end stream * stream method and naming * nostream * streaming * streamingoptions * without streaming example * string column instead of date -- related to BEAM-13753 * mor strings * spotless * revert, only DEFAULT and FILE_LOADS * [BEAM-13857] Add K:V flags for expansion service jars and addresses to Go ITs. (#16908) Adds functionality for running jars to the Go integration test framework, and uses this functionality to implement handling of K:V flags for providing expansion service jars and addresses to the test framework. This means that tests can simply get the address of an expansion service with the appropriate label, and this feature will handle running a jar if necessary, or just using the passed in endpoint otherwise. * BEAM-14011 fix s3 filesystem multipart copy * Merge pull request #16842 from [BEAM-13932][Playground] Container's user privileges * [BEAM-13932][Playground] Change Dockerfiles * [BEAM-13932][Playground] Update proxy and permissions for the container's user * [BEAM-13932][Playground] Update permissions for the container's user for scio * Doc updates and blog post for 2.37.0 (#16887) * Doc updates and blog post for 2.37.0 * Add BEAM-13980 to known issues * Update dates * Drop known issue (fix cherrypicked) * Add license * Add missing # * Remove resolved issue in docs + update class path on sample (#17018) * [BEAM-14016] Fixed flaky postcommit test (#17009) Fixed SpannerWriteIntegrationTest.test_spanner_update by fixing the metric exporter usage in spannerio. * [BEAM-13925] months in date constructor are 0 indexed * [BEAM-13947] Add split() and rsplit(), non-deferred column operations on categorical columns (#16677) * Add split/rsplit; Need to refactor regex * Support Regex; Refactor tests * Remove debugger * fix grammar * Fix passing regex arg * Reorder imports * Address PR comments; Simplify kwargs * Simplify getting columns for split_cat * Update doctests to skip expand=True operations * Fix missing doctest * py: Import beam plugins before starting SdkHarness * BEAM-14026 - Fixes bug related to Unnesting nested rows in an array (#16988) * Suggested changes to handle nested row in an array * Beam-14026 Suggested changes to handle nested row in an array * Beam-14026 Enhanced by segregating the code from getBaseValues enhanced test case and example. * Beam-14026 The code is moved from Row to avoid impact to the public interface. The code is moved to BeamUnnestRel.java since its the caller class. The Example code was duplicate, hence dropped. build.gradle updated with the removal of example code. * Remove resolved issue in notebook * Bump numpy bound to include 1.22 and regenerate container deps. * [BEAM-13925] Add ability to get metrics on pr-bot performance (#16985) * Add script to get metrics on pr-bot performance * Respond to feedback * fix bad condition * [BEAM-11085] Test that windows are correctly observed in DoFns * Give pr bot write permissions on pr update * Adding a logical type for Schemas using proto serialization. (#16940) * BEAM-13765 missing PAssert methods (#16668) * [BEAM-13909] improve coverage of Provision package (#17014) * improve coverage of provision package * updated comments * [BEAM-14050] Update taxi.go example instructions * Merge pull request #17027: [BEAM-11205] Upgrade GCP Libraries BOM dependencies to 24.4.0 * [BEAM-13709] Inconsistent behavior when parsing boolean flags across different APIs in Python SDK (#16929) * Update dataflow API client. * Instructions for updating apitools generated files. * [BEAM-10976] Bundle finalization: Harness and some exec changes (#16980) * Bundle finalization harness side changes * Add testing * Iterate over pardos directly * Track bundlefinalizer in plan.go not pardo * Remove outdated test * Fix pointer issue * Update todos to reference jiras * Cleanup from feedback * Doc nit Co-authored-by: Daniel Oliveira <younghoono@gmail.com> * GetExpirationTime comment Co-authored-by: github-actions <github-actions@github.com> Co-authored-by: Daniel Oliveira <younghoono@gmail.com> * Merge pull request #16976 from [BEAM-14010] [Website] Add Playground section to the Home page * [BEAM-14010] [Website] Add Playground section to the Home page * Update button to "Try Playground" Co-authored-by: Aydar Zainutdinov <aydar.zaynutdinov@akvelon.com> * [BEAM-14010] [Website] change button name * [BEAM-14010] [Website] align header to center * [BEAM-14010] [Website] change link Co-authored-by: Alex Kosolapov <alex.kosolapov@akvelon.com> Co-authored-by: Aydar Zainutdinov <aydar.zaynutdinov@akvelon.com> * [BEAM-12447] Upgrade cloud build client and add/cleanup options (#17032) * Merge pull request #17036 from [BEAM-12164] Convert all static instances to be transient in the connector in order to enable concurrent testing * Convert all static instances to be transient in the connector in order to enable concurrent testing * Initialized fields to null * nullness * Suppress uninitialized warnings * Remove resetting dao factory fields in SpannerChangeStreamErrorTest.java * Add validation package * fix variable reference (#16991) * Committed changes * Print more logging * More logging * Made pipelines streaming * Made small fixes * Small fixes * Ran spotless Apply Co-authored-by: emily <emilyye@google.com> Co-authored-by: egalpin <egalpin@users.noreply.github.com> Co-authored-by: Aydar Farrakhov <stranniknm@gmail.com> Co-authored-by: Miguel Hernandez <rogelio.hernandez@wizeline.com> Co-authored-by: Benjamin Gonzalez <74670721+benWize@users.noreply.github.com> Co-authored-by: Pavel Avilov <avilovpavel6@gmail.com> Co-authored-by: Artur Khanin <artur.khanin@akvelon.com> Co-authored-by: AydarZaynutdinov <aydar.zaynutdinov@akvelon.com> Co-authored-by: Ahmet Altay <aaltay@gmail.com> Co-authored-by: Jack McCluskey <34928439+jrmccluskey@users.noreply.github.com> Co-authored-by: Robert Burke <lostluck@users.noreply.github.com> Co-authored-by: laraschmidt <laraschmidt@users.noreply.github.com> Co-authored-by: Alexey Romanenko <aromanenko.dev@gmail.com> Co-authored-by: Victor <career@victorplusc.com> Co-authored-by: Danny McCormick <dannymccormick@google.com> Co-authored-by: Masato Nakamura <randomstep@gmail.com> Co-authored-by: Pablo Estrada <pabloem@apache.org> Co-authored-by: reuvenlax <relax@google.com> Co-authored-by: Miguel Hernandez <61989986+roger-mike@users.noreply.github.com> Co-authored-by: Moritz Mack <mmack@talend.com> Co-authored-by: Zoe <zoc@google.com> Co-authored-by: Brian Hulette <bhulette@google.com> Co-authored-by: brucearctor <5032356+brucearctor@users.noreply.github.com> Co-authored-by: Daniel Oliveira <daniel.o.programmer@gmail.com> Co-authored-by: sp029619 <stephen.patel@cerner.com> Co-authored-by: David Cavazos <dcavazos@google.com> Co-authored-by: Ning Kang <ningkang0957@gmail.com> Co-authored-by: github-actions <github-actions@github.com> Co-authored-by: Andy Ye <andyye333@gmail.com> Co-authored-by: Rahul Iyer <rahuliyer573@gmail.com> Co-authored-by: abhijeet-lele <56114083+abhijeet-lele@users.noreply.github.com> Co-authored-by: Valentyn Tymofieiev <valentyn@google.com> Co-authored-by: Marcin Kuthan <marcin.kuthan@gmail.com> Co-authored-by: Ritesh Ghorse <riteshghorse@gmail.com> Co-authored-by: Jack McCluskey <jrmccluskey@google.com> Co-authored-by: ansh0l <ansh0l@users.noreply.github.com> Co-authored-by: Anand Inguva <34158215+AnandInguva@users.noreply.github.com> Co-authored-by: Robert Bradshaw <robertwb@gmail.com> Co-authored-by: Daniel Oliveira <younghoono@gmail.com> Co-authored-by: bullet03 <bulat.safiullin@akvelon.com> Co-authored-by: Alex Kosolapov <alex.kosolapov@akvelon.com> Co-authored-by: Yichi Zhang <zyichi@google.com> Co-authored-by: Nancy Xu <nancyxu@google.com>

github-actions bot added build docker java labels Feb 14, 2022

benEng changed the title ~~[WIP] Upgrade BOM dependencies to 24.3.0~~ Upgrade BOM dependencies to 24.3.0 Feb 16, 2022

benEng marked this pull request as ready for review February 16, 2022 23:19

benEng changed the title ~~Upgrade BOM dependencies to 24.3.0~~ [WIP] Upgrade BOM dependencies to 24.3.0 Feb 17, 2022

benEng marked this pull request as draft February 17, 2022 19:59

benEng force-pushed the upgrade-bom-24_3 branch from 1d5dc93 to 50f9556 Compare February 17, 2022 23:29

Update bom version to 24.3.0

43dc4b9

benEng force-pushed the upgrade-bom-24_3 branch from 50f9556 to 43dc4b9 Compare February 21, 2022 19:49

benEng added 3 commits February 21, 2022 14:46

Update dependencies

94b5951

Update dependencies

38f55fc

Restore version update

827d44d

benEng marked this pull request as ready for review February 22, 2022 00:07

benEng changed the title ~~[WIP] Upgrade BOM dependencies to 24.3.0~~ Upgrade BOM dependencies to 24.3.0 Feb 22, 2022

suztomo reviewed Feb 22, 2022

View reviewed changes

benEng added 2 commits February 22, 2022 13:58

Rollback arrow_version update

a24a25c

Rollback netty_version

fd16c0e

suztomo changed the title ~~Upgrade BOM dependencies to 24.3.0~~ [BEAM-11205] Upgrade Libraries BOM dependencies to 24.3.0 Feb 23, 2022

benEng requested a review from suztomo March 1, 2022 18:28

suztomo approved these changes Mar 1, 2022

View reviewed changes

suztomo merged commit d42d8d7 into apache:master Mar 1, 2022

nancyxu123 pushed a commit to nancyxu123/beam that referenced this pull request Mar 10, 2022

Merge pull request apache#16850: [BEAM-11205] Upgrade Libraries BOM d…

32cfde8

…ependencies to 24.3.0 * Update GCP Libraries BOM version to 24.3.0 * Update associated dependencies

[BEAM-11205] Upgrade Libraries BOM dependencies to 24.3.0 #16850

[BEAM-11205] Upgrade Libraries BOM dependencies to 24.3.0 #16850

Uh oh!

Conversation

benEng commented Feb 14, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

ValidatesRunner compliance status (on master branch)

Examples testing status on various runners

Post-Commit SDK/Transform Integration Tests Status (on master branch)

Pre-Commit Tests Status (on master branch)

GitHub Actions Tests Status (on master branch)

Uh oh!

codecov bot commented Feb 14, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

benEng commented Feb 16, 2022

Uh oh!

benEng commented Feb 16, 2022

Uh oh!

benEng commented Feb 16, 2022

Uh oh!

benEng commented Feb 22, 2022

Uh oh!

suztomo Feb 22, 2022

Choose a reason for hiding this comment

Uh oh!

benEng Feb 22, 2022

Choose a reason for hiding this comment

Uh oh!

suztomo Feb 22, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

benEng Feb 22, 2022

Choose a reason for hiding this comment

Uh oh!

benEng Feb 22, 2022

Choose a reason for hiding this comment

Uh oh!

suztomo Feb 22, 2022

Choose a reason for hiding this comment

Uh oh!

suztomo Feb 22, 2022

Choose a reason for hiding this comment

Uh oh!

suztomo Feb 22, 2022

Choose a reason for hiding this comment

Uh oh!

suztomo commented Feb 22, 2022

Linkage Errors from optional dependencies

Linkage Errors from GraalVM (or svm)

Uh oh!

benEng commented Feb 22, 2022

Uh oh!

suztomo commented Feb 23, 2022

Uh oh!

suztomo commented Feb 23, 2022

Uh oh!

suztomo commented Feb 23, 2022

Uh oh!

suztomo commented Feb 23, 2022

Uh oh!

suztomo commented Feb 23, 2022

Uh oh!

suztomo commented Feb 23, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

suztomo commented Feb 23, 2022

Uh oh!

benEng commented Feb 23, 2022

Uh oh!

benEng commented Feb 23, 2022

Uh oh!

benEng commented Feb 23, 2022

Uh oh!

benEng commented Feb 23, 2022

Uh oh!

benEng commented Feb 23, 2022

Uh oh!

benEng commented Feb 14, 2022 •

edited

Loading

`ValidatesRunner` compliance status (on master branch)

codecov bot commented Feb 14, 2022 •

edited

Loading

suztomo Feb 22, 2022 •

edited

Loading

suztomo commented Feb 23, 2022 •

edited

Loading