Skip to content

Create workflow Kani Extra for checks that run conditionally on labels#2837

Merged
celinval merged 3 commits intomodel-checking:mainfrom
celinval:issue-2606-ci-label
Oct 26, 2023
Merged

Create workflow Kani Extra for checks that run conditionally on labels#2837
celinval merged 3 commits intomodel-checking:mainfrom
celinval:issue-2606-ci-label

Conversation

@celinval
Copy link
Contributor

The "Auto Label" workflow correctly label our PRs; however, this action do not trigger a PR 'labeled' workflow. To automatically do that, we now changed the CI structure to have a new workflow with extra jobs that are conditional to labels and files being modified.

This new workflow starts by triggering the auto-label job. The benchmark workflow is only triggered if after the auto-label job, the PR has a Z-BenchCI label.

This also means that the benchmark workflow will now run after any update to a PR that has the 'Z-BenchCI' label.

Resolves #2606

Call-out

I manually tested these changes in my branch with this dummy PR: celinval#19. The new workflow can be seen here and the benchcomp run shows up in the list of job as "Kani Extra / Verification Benchmarks / perf-benchcomp".

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 and MIT licenses.

The "Auto Label" workflow correctly label our PRs; however, this action
do not trigger a PR 'labeled' workflow. To automatically do that, we
now changed the CI structure to have a new workflow with extra jobs
that are conditional to labels and files being modified.

This new workflow starts by triggering the auto-label job. The benchmark
workflow is only triggered if after the auto-label job, the PR has a
Z-BenchCI label.

This also means that the benchmark workflow will now run after any
update to a PR that has the 'Z-BenchCI' label.
@celinval celinval requested a review from a team as a code owner October 25, 2023 00:22
Copy link
Contributor

@jaisnan jaisnan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome change! Thank you

@jaisnan
Copy link
Contributor

jaisnan commented Oct 26, 2023

This also means that the benchmark workflow will now run after any update to a PR that has the 'Z-BenchCI' label.

Is this a unwanted side-effect? I thought this was the intention behind this change?

@celinval
Copy link
Contributor Author

This also means that the benchmark workflow will now run after any update to a PR that has the 'Z-BenchCI' label.

Is this a unwanted side-effect? I thought this was the intention behind this change?

Not a side effect. I just wanted to call out that this is more than just refactoring.

@celinval celinval merged commit ecd8957 into model-checking:main Oct 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Automate running benchmarks in PRs that are more likely to impact performance

2 participants