Skip to content

Conversation

@dannymartinm
Copy link
Contributor

As part of the issue #21106, @elink21 and I have implemented the self-hosted runners for the Ubuntu and Windows operating systems.

Please see the Approved Pull Request (PR#22703) for reference.

In this PR you will find the following changes:

  • Docker and Kubernetes files to reproduce the environment of the Ubuntu runners in local and in Google Kubernetes Engine
  • Scripts for the Windows runners implementation on GCP Compute Engine (VMs)
  • Cloud Function scripts
  • Detailed documentation in README files

Note: We will rely on GitHub-hosted runners for MacOS builds until a straightforward implementation approach comes out.

PR#16511 : Previous PR for reference.
BEAM-12812: Original Jira may contain additional context.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI.

@github-actions github-actions bot added the build label Sep 9, 2022
@github-actions
Copy link
Contributor

github-actions bot commented Sep 9, 2022

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @Abacn for label build.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

@dannymartinm
Copy link
Contributor Author

Hi @Abacn @damccorm, could you help us with a PR review please?
Thank you!

Windows Virtual machines have the following specifications

#### VM specifications
* Instance Template: _TODO: Add GCP link when final resources are in place._
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Calling out this TODO since we should resolve before merging if possible, or create an issue if not

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have resolved the image nomenclature, it's going to be added, thanks!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are adding the template name instead since a hardcoded link will become outdated quickly.

dannymartinm and others added 4 commits September 13, 2022 14:53
Co-authored-by: Danny McCormick <dannymccormick@google.com>
Co-authored-by: Danny McCormick <dannymccormick@google.com>
…stead of inner conditions.

Co-authored-by: Danny McCormick <dannymccormick@google.com>
Co-authored-by: Danny McCormick <dannymccormick@google.com>
* Implementing Review Changes

* Refactoring to use find instead of plain loops and adding env var validation

* Adding REQUIRED_ENV_VARS as a constant

Co-authored-by: Elias Segundo <elias.segundo@luisrazo.local>
elink21 and others added 2 commits September 14, 2022 17:48
* Using octokit paginate

Co-authored-by: Elias Segundo <elias.segundo@luisrazo.local>
Copy link
Contributor

@damccorm damccorm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the changes, looks good to me!

@damccorm damccorm merged commit 283f3b1 into apache:master Sep 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants