Skip to content

Conversation

@sonam-vend
Copy link
Contributor

@sonam-vend sonam-vend commented Jan 7, 2021

Since enabling the strict dependencies on all Java modules is a large and critical change to be merged all at once. Therefore, task [BEAM-10961] is divided into sub-tasks and strict dependencies are enabled to each module separately which is comparatively easy to review and merge.Please add a meaningful description for your change here


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang SDK Dataflow Flink Samza Spark Twister2
Go Build Status --- Build Status --- Build Status ---
Java Build Status Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status Build Status
Build Status
Build Status
Build Status
Python Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
--- Build Status ---
XLang Build Status Build Status Build Status --- Build Status ---

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website Whitespace Typescript
Non-portable Build Status Build Status
Build Status
Build Status
Build Status
Build Status Build Status Build Status Build Status
Portable --- Build Status --- --- --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests

See CI.md for more information about GitHub Actions CI.

@aromanenko-dev
Copy link
Contributor

@sonam-vend Is there any Jira issue(s) about these "Enabled strict dependency ..." PRs?

@sonam-vend
Copy link
Contributor Author

@sonam-vend Is there any Jira issue(s) about these "Enabled strict dependency ..." PRs?

Yes, there is one https://issues.apache.org/jira/browse/BEAM-10961

@sonam-vend
Copy link
Contributor Author

Run Java PreCommit

@aromanenko-dev
Copy link
Contributor

aromanenko-dev commented Jan 7, 2021

Yes, there is one https://issues.apache.org/jira/browse/BEAM-10961

@sonam-vend Great! Could you add a prefix with Jira ID (like "[BEAM-10961]") to PRs and commit messages? It will allow automatically link a PR with a correspondent Jira issue and make it easier to observe the history of changes in the future.

Ptal on this as well:
https://beam.apache.org/contribute/#make-your-change

@sonam-vend sonam-vend changed the title Enabled strict dependency over sdks-io [BEAM-10961] Enabled strict dependency over sdks-io Jan 7, 2021
// "spotbugs-annotations:3.1.12" used in Beam. Not required.
exclude group: "org.apache.zookeeper", module: "zookeeper"
// "kafka-clients" has to be provided since user can use its own version.
exclude group: "org.apache.kafka", module: "kafka-clients"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For :sdks:java:container:generateLicenseReport to succeed, had to exclude kafka-clients and zookeeper.

@sonam-vend
Copy link
Contributor Author

R: @ibzib , @aaltay can you please review or add reviewers who can review this.


dependencies {
compile library.java.google_api_services_bigquery
testImplementation library.java.google_api_services_bigquery
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No need for compile+permitUnusedDeclared here since this bigquery-io-perf-tests just contains tests.

@shehzaadn-vd
Copy link
Contributor

@ibzib do you think this is good to go?

Copy link

@ibzib ibzib left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd still prefer this PR to be split up further, with one file per PR (with the exception of kinesis and kinesis/expansion-service, which are fine to put in the same PR if you like). These files are totally unrelated but for the fact that they are IOs, so it will be much easier to review each file separately. Many of these files are ready to merge right now, like in #13902. But when files that are ready to merged are mixed in with files that are not, it becomes very time-consuming to review, since every time I have to re-evaluate which files are ready and which need changes. Plus, it is a lot easier to roll back smaller changes in case we accidentally create a bug.

@shehzaadn-vd
Copy link
Contributor

I'd still prefer this PR to be split up further, with one file per PR (with the exception of kinesis and kinesis/expansion-service, which are fine to put in the same PR if you like). These files are totally unrelated but for the fact that they are IOs, so it will be much easier to review each file separately. Many of these files are ready to merge right now, like in #13902. But when files that are ready to merged are mixed in with files that are not, it becomes very time-consuming to review, since every time I have to re-evaluate which files are ready and which need changes. Plus, it is a lot easier to roll back smaller changes in case we accidentally create a bug.

@ibzib Point well taken. 21 PRs coming up :-)

@sonam-vend sonam-vend marked this pull request as draft February 24, 2021 03:21
@ibzib
Copy link

ibzib commented Sep 15, 2021

This PR was broken up and merged in pieces.

@ibzib ibzib closed this Sep 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants