Reland minibench refactor

[kirklandsign]

Reland ebab7bb

Resolved: #8578

Test Plan: See this one has meaningful result https://hud.pytorch.org/benchmark/llms?startTime=Thu,%2017%20Apr%202025%2017:56:13%20GMT&stopTime=Thu,%2024%20Apr%202025%2017:56:13%20GMT&granularity=day&repoName=pytorch%2Fexecutorch&benchmarkName=&modelName=meta-llama%2FLlama-3.2-1B-Instruct-QLORA_INT4_EO8&backendName=llama3_qlora&modeName=inference&dtypeName=&deviceName=Samsung%20Galaxy%20S22%205G%20(Android%2013)&archName=All%20Platforms

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/10417

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures

As of commit 097d4d5 with merge base d31ef13 ():

NEW FAILURES - The following jobs have failed:

• pull / android / run-emulator (gh)
  The process '/usr/bin/sh' failed with exit code 255
• pull / unittest-arm / linux-job (gh)
  RuntimeError: Command docker exec -t c8e2a4386ac9f79dc107327b59fc5e82b990fe9f2015c810d85a6c5fcc9a5aec /exec failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

@kirklandsign has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@kirklandsign has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.