Skip to content

Remove AWS Device Farm benchmark jobs#15433

Merged
GregoryComer merged 1 commit intopytorch:mainfrom
GregoryComer:disable-device-farm-benchmarks
Nov 21, 2025
Merged

Remove AWS Device Farm benchmark jobs#15433
GregoryComer merged 1 commit intopytorch:mainfrom
GregoryComer:disable-device-farm-benchmarks

Conversation

@GregoryComer
Copy link
Member

Summary

Take down the AWS device farm benchmarking jobs. We are dropping them due to performance data being unreliable on non-rooted devices.

@pytorch-bot
Copy link

pytorch-bot bot commented Oct 28, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15433

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

✅ No Failures

As of commit 81b815a with merge base 2cafc34 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 28, 2025
@GregoryComer GregoryComer added ciflow/trunk and removed CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. labels Oct 28, 2025
@github-actions
Copy link

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@GregoryComer
Copy link
Member Author

Note: I'm dropping the build-benchmark-app jobs, since they're built per benchmark run. If we want to keep those, I can move them to pull/trunk jobs to make sure they build. Let me know and I'll do that.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 29, 2025
@GregoryComer GregoryComer marked this pull request as ready for review October 29, 2025 17:26
@GregoryComer GregoryComer force-pushed the disable-device-farm-benchmarks branch from 73be69b to 81b815a Compare October 29, 2025 17:26
@GregoryComer
Copy link
Member Author

@mergennachin are we ready to take down the benchmark jobs?

@GregoryComer GregoryComer merged commit 7905104 into pytorch:main Nov 21, 2025
441 of 443 checks passed
jirioc pushed a commit to nxp-upstream/executorch that referenced this pull request Dec 19, 2025
### Summary
Take down the AWS device farm benchmarking jobs. We are dropping them
due to performance data being unreliable on non-rooted devices.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants