Skip to content

Automate running benchmarks in PRs that are more likely to impact performance #2606

@celinval

Description

@celinval

Proposed change:

  • Automatically run performance benchmark workflow if the PR code has changed and the PR has the "Z-benchCI" label.
  • Automatically tag PRs with "Z-benchCI" if they touch files are likely to impact Kani's performance. For example:
    • kani-compiler/**
    • rust-toolchain.toml
    • kani-dependencies
    • kani-driver/src/call-*

Motivation: After #2604, running benchmark workflow for a PR will be triggered manually. In order to reduce the risks of forgetting to do so, we should automate running the workflow in riskier scenarios.

My suggestion is to use the Z-benchCI as the source of truth for whether the workflow runs or not. This will allow us to override the automation. For example, if the changes only touches comments of a compiler file.

Metadata

Metadata

Assignees

Labels

[C] InternalTracks some internal work. I.e.: Users should not be affected.[I] CI / InfrastructureWork done to CI, tests and infrastructure.

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions