-
Notifications
You must be signed in to change notification settings - Fork 4.5k
[BEAM-22] Enable RunnableOnService Tests #319
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
e8255cf to
e4fc8b4
Compare
|
Takes ~1.5m to build the direct runner + run the additional RunnableOnService Tests on Jenkins; about 2-3 on the slower travis targets. |
|
R: @kennknowles |
|
Nice. Since we will, afterwards, be removing the test runs of the current |
|
It does seem that the cost on travis is much greater. |
|
You can actually do the disabling of redundant tests in this PR by adding |
Reduces the number of active threads, which should improve scheduling behavior. Additionally improves caching behavior of ParDo evaluators due to increased reuse of DoFns.
Explicitly remove beamTestPipelineOptions in examples. Otherwise, running the examples after a PipelineRunner with
With the direct runner executing all of this category (in runners/direct-java), we maintain this test coverage without running these tests while building the Core SDK. Required to remove the legacy direct runner.
|
LGTM. I think it is time to merge this. |
Add UnboundedCountingInput#withRate
* chore: manual synth * ran synthtool to add bundle proto definitions * beginning of bundle implementation added methods to assemble bundles, but not yet serialize them into length-prefixed json strings with tests for bundle assembly * linting * Added bundle build method * fixed incomplete document id * fixed git merge error * Added first draft of docstrings * Added FirestoreBundle deserialization * Fixed import desync * Improved test coverage for bundles * linting * test coverage * CI happiness * converted redundant exception to assertion * removed todo * Updated comments * linted * Moved query limit type into bundle code * Added typed response for parsing reference values * refactored document reference parsing * removed auto import of bundles from firestore * small tweaks * added tests for document iters * Updated FirestoreBundle imports and synthtool gen * linting * extra test coverage * responses to code review * linting * Fixed stale docstring * camelCased bundle output * updated stale comments * Added test for binary data * linting Co-authored-by: Craig Labenz <craiglabenz@google.com> Co-authored-by: Christopher Wilcox <crwilcox@google.com>
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
[BEAM-<Jira issue #>] Description of pull requestmvn clean verify. (Even better, enableTravis-CI on your fork and ensure the whole test matrix passes).
<Jira issue #>in the title with the actual Jira issuenumber, if there is one.
Individual Contributor License Agreement.
Not ready for review. Publishing PR to hook into Travis and Jenkins.
Update runners/direct-java/pom.xml to enable the RunnableOnService
tests phase.