-
Notifications
You must be signed in to change notification settings - Fork 4.5k
[BEAM-13211][Playground] Add function to find all tagged files #16072
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BEAM-13211][Playground] Add function to find all tagged files #16072
Conversation
…tions (#83) * Update workflows for playground * Attempt to fix tests * Remove continue on error to catch errors * Fix linter problem for backend dockerfile * Update folder to run backend go linter * Moved flutter test to execution via gradle tasks
implemented method to find all tagged files; added categories.yaml file; added requirements.txt file;
f0252fb to
005775b
Compare
|
R: @pabloem |
pabloem
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks good to me. Just added a couple comments.
playground/categories.yaml
Outdated
|
|
||
| categories: | ||
| - Side Input | ||
| - Side Output |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| - Side Output | |
| - Multiple Outputs |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Changed.
playground/categories.yaml
Outdated
| - Side Output | ||
| - Testing | ||
| - Schemas | ||
| - Transform |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
maybe add
- Batch
- Streaming
- Combiners
- Dataframes
- Joins
What do you mean by 'transform' here? Maybe we can rneame it to be more clear?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I added all categories which you suggested instead of Transform.
| pass | ||
| has_error = False | ||
| examples = [] | ||
| for root, _, files in os.walk(work_dir): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
have you ran this? do you know how long it takes to run? just curious
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes. I have run a little test to check how long this method works. Now it takes about 16 seconds.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
alright cool thanks!
[BEAM-13211]
added function to find all tagged files;
added
categories.yamlfile;added
requirements.txtfile;Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
R: @username).[BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replaceBEAM-XXXwith the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.CHANGES.mdwith noteworthy changes.See the Contributor Guide for more tips on how to make review process smoother.
ValidatesRunnercompliance status (on master branch)Examples testing status on various runners
Post-Commit SDK/Transform Integration Tests Status (on master branch)
Pre-Commit Tests Status (on master branch)
See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.