Skip to content

[Tooling] Report Firebase Test Failures as Buildkite Annotations (take 2)#17584

Merged
AliSoftware merged 5 commits intotrunkfrom
tooling/firebase-test-failure-annotation-take2
Dec 1, 2022
Merged

[Tooling] Report Firebase Test Failures as Buildkite Annotations (take 2)#17584
AliSoftware merged 5 commits intotrunkfrom
tooling/firebase-test-failure-annotation-take2

Conversation

@AliSoftware
Copy link
Contributor

@AliSoftware AliSoftware commented Nov 30, 2022

See #17581 for details

image

Warning This PR should NOT be merged until we do a new version of the release-toolkit that ships with the changes from wordpress-mobile/release-toolkit#430

Why?

I accidentally merged #17581 too soon, before a new release for the release-toolkit was done and I could point to it.

So I reverted the early merge in #17583, and here we are in this PR, preparing the exact same changes again (that were already approved in #17581), but this time we will make sure to wait for a new release before merging it… right?

TODO

  • Point to the new version of release-toolkit once one gets published, then remove the Not Ready for Merge label once done.

@AliSoftware AliSoftware added this to the 21.4 milestone Nov 30, 2022
@AliSoftware AliSoftware requested a review from a team November 30, 2022 16:16
@AliSoftware AliSoftware self-assigned this Nov 30, 2022
Copy link
Contributor

@ParaskP7 ParaskP7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! 💯

@wpmobilebot
Copy link
Contributor

wpmobilebot commented Nov 30, 2022

WordPress📲 You can test these changes on WordPress by downloading wordpress-installable-build-pr17584-8e2c00a.apk
💡 Scan this QR code with your Android phone to download and install the APK directly on it.
AppWordPress
Build FlavorJalapeno
Build TypeDebug
Commit8e2c00a
Note: This installable build uses the JalapenoDebug build flavor, and does not support Google Login.

@wpmobilebot
Copy link
Contributor

wpmobilebot commented Nov 30, 2022

Jetpack📲 You can test these changes on Jetpack by downloading jetpack-installable-build-pr17584-8e2c00a.apk
💡 Scan this QR code with your Android phone to download and install the APK directly on it.
AppJetpack
Build FlavorJalapeno
Build TypeDebug
Commit8e2c00a
Note: This installable build uses the JalapenoDebug build flavor, and does not support Google Login.

@AliSoftware
Copy link
Contributor Author

this time we will make sure to wait for a new release before merging it… right?

Once Automattic/peril-settings#103 lands , if someone could remove-then-re-add the "Do Not Merge" label to this PR in order to re-trigger Peril on it and ensure it will guarantee preventing accidental merge of it, that would be nice 🙂

@AliSoftware AliSoftware force-pushed the tooling/firebase-test-failure-annotation-take2 branch from c0e377b to b59e8e8 Compare November 30, 2022 19:23
Gemfile Outdated
Comment on lines +10 to +12
gem 'fastlane-plugin-wpmreleasetoolkit', '~> 6.0'
# gem 'fastlane-plugin-wpmreleasetoolkit', '~> 6.0'
#gem 'fastlane-plugin-wpmreleasetoolkit', path: '../../release-toolkit'
#gem 'fastlane-plugin-wpmreleasetoolkit', git: 'https://github.com/wordpress-mobile/release-toolkit', branch: ''
gem 'fastlane-plugin-wpmreleasetoolkit', git: 'https://github.com/wordpress-mobile/release-toolkit', branch: 'trunk'
Copy link
Contributor Author

@AliSoftware AliSoftware Nov 30, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ 🚧 Reminder that before merging this PR, we need to revert those temporary changes above and point to the new version of release-toolkit after we published it in RubyGems.

So that in case a first iteration of the Instrumented Tests failed and generated an annotation, and the failed build gets retried, we make sure the previous failure annotation is then removed if the retry succeeds.
@AliSoftware AliSoftware merged commit 33deb7a into trunk Dec 1, 2022
@AliSoftware AliSoftware deleted the tooling/firebase-test-failure-annotation-take2 branch December 1, 2022 16:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants