Skip to content

Conversation

@msbukal
Copy link
Contributor

@msbukal msbukal commented Jan 22, 2021

Add success, failure and latency metrics to FHIRIO read, execute bundle and search methods.
Update metric naming to adhere to a consistent standard, and fixed incorrect metric names (eg. "successful-hl7v2-message-gets" for FhirIO.Read).
Update latency measurements to recommended java 8 time approach (java.time.Instant)


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang SDK Dataflow Flink Samza Spark Twister2
Go Build Status --- Build Status --- Build Status ---
Java Build Status Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status Build Status
Build Status
Build Status
Build Status
Python Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
--- Build Status ---
XLang Build Status Build Status Build Status --- Build Status ---

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website Whitespace Typescript
Non-portable Build Status Build Status
Build Status
Build Status
Build Status
Build Status Build Status Build Status Build Status
Portable --- Build Status --- --- --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests

See CI.md for more information about GitHub Actions CI.

@msbukal
Copy link
Contributor Author

msbukal commented Jan 22, 2021

I believe the failure in "Run Java PreCommit" is a flake, I was unable to reproduce it.

@msbukal
Copy link
Contributor Author

msbukal commented Jan 22, 2021

R: @pabloem

@pabloem
Copy link
Member

pabloem commented Jan 25, 2021

Run Java PreCommit

@pabloem
Copy link
Member

pabloem commented Jan 25, 2021

thanks @msbukal - these will be useful to debug jobs, and may be useful for perf tests if they're ever implemented.

@pabloem
Copy link
Member

pabloem commented Jan 25, 2021

Run Java PreCommit

@pabloem
Copy link
Member

pabloem commented Jan 25, 2021

this is clearly an unrelated flake. FWIW, this change LGTM, so no more action needed from you @msbukal

I'll rerun presubmits until we get a green run

@pabloem
Copy link
Member

pabloem commented Jan 25, 2021

Run Java PreCommit

private final Counter SEARCH_RESOURCE_SUCCESS =
Metrics.counter(
SearchResourcesFn.class, BASE_METRIC_PREFIX + "search_resource_success_count");
private final Distribution SEARCH_RESOURCE_LATENCY_MS =
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh there seems to be a style error for these variables. They should be static, or not capitalized. fyi: @msbukal

[ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Phrase/src/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIO.java:1614:31: Name 'SEARCH_RESOURCE_ERRORS' must match pattern '^[a-z][a-zA-Z0-9]*$'. [MemberName] |  
  | [ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Phrase/src/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIO.java:1617:31: Name 'SEARCH_RESOURCE_SUCCESS' must match pattern '^[a-z][a-zA-Z0-9]*$'. [MemberName] |  
  | [ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Phrase/src/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIO.java:1620:36: Name 'SEARCH_RESOURCE_LATENCY_MS' must match pattern '^[a-z][a-zA-Z0-9]*$'. [MemberName]

Usually, when a unit test fails, it is displayed directly in Jenkins. In this case it wasn't, because it was something else failing.

To find these kinds of errors, you can open PreCommit, and then open the Gradle Build Scan, which will point you to the failing task.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah I see, these fields can't be static because of the template (keep going round & round in errors due to this) which means that the metric fields can't be static.

I've renamed them.

@codecov
Copy link

codecov bot commented Jan 26, 2021

Codecov Report

Merging #13792 (390fb7e) into master (0dd6980) will increase coverage by 0.00%.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master   #13792   +/-   ##
=======================================
  Coverage   82.76%   82.77%           
=======================================
  Files         466      466           
  Lines       57558    57558           
=======================================
+ Hits        47638    47641    +3     
+ Misses       9920     9917    -3     
Impacted Files Coverage Δ
sdks/python/apache_beam/io/iobase.py 84.55% <0.00%> (-0.27%) ⬇️
...hon/apache_beam/runners/worker/bundle_processor.py 93.83% <0.00%> (+0.38%) ⬆️
sdks/python/apache_beam/utils/interactive_utils.py 95.23% <0.00%> (+2.38%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 29b9542...075e70b. Read the comment docs.

@pabloem
Copy link
Member

pabloem commented Jan 26, 2021

precommit error is unrelated (in fact, it's my fault in a different PR) - I'll merge once I fix precommit on master

@pabloem pabloem closed this Jan 26, 2021
@pabloem pabloem reopened this Jan 26, 2021
@pabloem
Copy link
Member

pabloem commented Jan 26, 2021

closing and opening hoping to retrigger the tests and the merge at the top of master (since now it has the fix for the breakage)

@pabloem
Copy link
Member

pabloem commented Jan 26, 2021

Run Java PreCommit

1 similar comment
@pabloem
Copy link
Member

pabloem commented Jan 26, 2021

Run Java PreCommit

@pabloem pabloem merged commit dde38b6 into apache:master Jan 26, 2021
@msbukal msbukal deleted the METRICS branch February 19, 2021 19:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants