[Bug]: Latest version (2.57) version of apache beam java sdk has dependecy on an old version of mongo driver (3.12) #32088
Description
What happened?
I am using spring boot 3.2.4 with beam-sdks-java-core:2.57.0. When you look at the dependency output, it is seen that the latest version of the java beam sdk has dependency to older mongodb driver. This is causing runtime error - "org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.util.concurrent.UncheckedExecutionException: org.apache.beam.sdk.util.UserCodeException: java.lang.NoSuchMethodError: 'java.lang.Integer com.mongodb.ConnectionString.getThreadsAllowedToBlockForConnectionMultiplier()"
On analysis, I see that the spring boot data mongo depends on 4.11.0 version of the mongo driver whereas the the latest beansdk java-io-mongodb has dependecy of 3.12.11. This leads to the above runtime error. Appreciate if mongo driver 4.xx support can be provided for the latest beam java sdk.
The gradle dependency tree shown below for reference:
Output of ./gradlew dependencies --configuration compileClasspath
+--- org.apache.beam:beam-sdks-java-io-mongodb:2.57.0
| +--- org.checkerframework:checker-qual:3.42.0
| +--- org.apache.beam:beam-sdks-java-core:2.57.0
| | +--- org.apache.beam:beam-model-pipeline:2.57.0
| | | +--- org.apache.beam:beam-vendor-grpc-1_60_1:0.2
| | | +--- com.google.auto.value:auto-value-annotations:1.8.2
| | | +--- com.google.errorprone:error_prone_annotations:2.20.0
| | | +--- org.apache.httpcomponents:httpclient:4.5.13
| | | | +--- org.apache.httpcomponents:httpcore:4.4.13 -> 4.4.16
| | | | +--- commons-logging:commons-logging:1.2
| | | | --- commons-codec:commons-codec:1.11 -> 1.16.1
| | | +--- org.apache.httpcomponents:httpcore:4.4.15 -> 4.4.16
| | | --- org.conscrypt:conscrypt-openjdk-uber:2.5.2
| | +--- org.apache.beam:beam-model-fn-execution:2.57.0
| | | +--- org.apache.beam:beam-vendor-grpc-1_60_1:0.2
| | | +--- com.google.auto.value:auto-value-annotations:1.8.2
| | | +--- com.google.errorprone:error_prone_annotations:2.20.0
| | | +--- org.apache.httpcomponents:httpclient:4.5.13 ()
| | | +--- org.apache.httpcomponents:httpcore:4.4.15 -> 4.4.16
| | | --- org.conscrypt:conscrypt-openjdk-uber:2.5.2
| | +--- org.apache.beam:beam-model-job-management:2.57.0
| | | +--- org.apache.beam:beam-vendor-grpc-1_60_1:0.2
| | | +--- com.google.auto.value:auto-value-annotations:1.8.2
| | | +--- com.google.errorprone:error_prone_annotations:2.20.0
| | | +--- org.apache.httpcomponents:httpclient:4.5.13 ()
| | | +--- org.apache.httpcomponents:httpcore:4.4.15 -> 4.4.16
| | | --- org.conscrypt:conscrypt-openjdk-uber:2.5.2
| | +--- org.apache.beam:beam-sdks-java-transform-service-launcher:2.57.0
| | | +--- org.checkerframework:checker-qual:3.42.0
| | | +--- org.apache.beam:beam-vendor-guava-32_1_2-jre:0.1
| | | +--- org.slf4j:slf4j-api:1.7.30 -> 2.0.12
| | | --- args4j:args4j:2.33
| | +--- org.apache.beam:beam-vendor-grpc-1_60_1:0.2
| | +--- org.apache.beam:beam-vendor-guava-32_1_2-jre:0.1
| | +--- net.bytebuddy:byte-buddy:1.14.12
| | +--- org.antlr:antlr4-runtime:4.7
| | +--- org.apache.commons:commons-compress:1.26.2
| | | +--- commons-codec:commons-codec:1.17.0 -> 1.16.1
| | | +--- commons-io:commons-io:2.16.1
| | | --- org.apache.commons:commons-lang3:3.14.0 -> 3.13.0
| | +--- org.apache.commons:commons-lang3:3.14.0 -> 3.13.0
| | +--- io.github.classgraph:classgraph:4.8.162
| | +--- com.google.code.findbugs:jsr305:3.0.2
| | +--- com.google.errorprone:error_prone_annotations:2.10.0 -> 2.20.0
| | +--- com.fasterxml.jackson.core:jackson-core:2.15.4
| | | --- com.fasterxml.jackson:jackson-bom:2.15.4
| | | +--- com.fasterxml.jackson.core:jackson-annotations:2.15.4 (c)
| | | +--- com.fasterxml.jackson.core:jackson-core:2.15.4 (c)
| | | +--- com.fasterxml.jackson.core:jackson-databind:2.15.4 (c)
| | | +--- com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.15.4 (c)
| | | +--- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:2.15.4 (c)
| | | --- com.fasterxml.jackson.module:jackson-module-parameter-names:2.15.4 (c)
| | +--- com.fasterxml.jackson.core:jackson-annotations:2.15.4
| | | --- com.fasterxml.jackson:jackson-bom:2.15.4 ()
| | +--- com.fasterxml.jackson.core:jackson-databind:2.15.4
| | | +--- com.fasterxml.jackson.core:jackson-annotations:2.15.4 ()
| | | +--- com.fasterxml.jackson.core:jackson-core:2.15.4 ()
| | | --- com.fasterxml.jackson:jackson-bom:2.15.4 ()
| | +--- org.slf4j:slf4j-api:1.7.30 -> 2.0.12
| | +--- org.xerial.snappy:snappy-java:1.1.10.4
| | --- joda-time:joda-time:2.10.10
| +--- joda-time:joda-time:2.10.10
| +--- org.mongodb:mongo-java-driver:3.12.11
Issue Priority
Priority: 2 (default / most bugs should be filed as P2)
Issue Components
- Component: Python SDK
- Component: Java SDK
- Component: Go SDK
- Component: Typescript SDK
- Component: IO connector
- Component: Beam YAML
- Component: Beam examples
- Component: Beam playground
- Component: Beam katas
- Component: Website
- Component: Infrastructure
- Component: Spark Runner
- Component: Flink Runner
- Component: Samza Runner
- Component: Twister2 Runner
- Component: Hazelcast Jet Runner
- Component: Google Cloud Dataflow Runner