Skip to content

feat: benchmark edit actions#863

Merged
brprice merged 4 commits intomainfrom
brprice/benchmark-edits
Feb 23, 2023
Merged

feat: benchmark edit actions#863
brprice merged 4 commits intomainfrom
brprice/benchmark-edits

Conversation

@brprice
Copy link
Copy Markdown
Contributor

@brprice brprice commented Feb 1, 2023

No description provided.

Comment thread primer-benchmark/src/Main.hs Outdated
@brprice brprice force-pushed the brprice/benchmark-edits branch from 335ac70 to 28e524c Compare February 2, 2023 11:45
@brprice brprice force-pushed the brprice/benchmark-edits branch from 28e524c to b114f19 Compare February 2, 2023 15:47
@brprice brprice force-pushed the brprice/benchmark-tc branch from 903c429 to 4e5b3c6 Compare February 3, 2023 17:21
@brprice brprice force-pushed the brprice/benchmark-edits branch 2 times, most recently from 96f8b67 to 7ffe906 Compare February 3, 2023 18:24
@brprice brprice force-pushed the brprice/benchmark-tc branch from 4e5b3c6 to c5573ad Compare February 4, 2023 13:14
@brprice brprice force-pushed the brprice/benchmark-edits branch 2 times, most recently from f60c8f1 to 15829f3 Compare February 4, 2023 14:37
Comment thread flake.nix Outdated
Comment thread flake.nix Outdated
Comment thread primer-benchmark/README.md Outdated
@@ -0,0 +1,73 @@
Edit [RenameDef (GlobalName {qualifiedModule = ModuleName {unModuleName = "Main" :| []}, baseName = "main"}) "sayHello"]
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can imagine these getting pretty long. I suppose there's some value in leaving the logs as plaintext, because being able to see the diffs when they're updated might occasionally be useful, but I'm inclined to want to compress these before committing them to the repo.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For what reasons in particular? (Note that, iiuc, git internally stores files compressed (in slightly different ways depending on if it is a loose object or part of a pack file), so I'm not sure it will save much space in the repo. (It will save some in a checkout though).

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They might get unwieldy if they grow to a few megabytes. I suppose we can leave them uncompressed for now and see how it goes.

Comment thread primer-benchmark/fixtures/sayHello.out Outdated
@brprice brprice force-pushed the brprice/benchmark-tc branch from c5573ad to dce4982 Compare February 7, 2023 12:42
@brprice brprice force-pushed the brprice/benchmark-edits branch from 15829f3 to 84e5a17 Compare February 8, 2023 14:42
Base automatically changed from brprice/benchmark-tc to main February 8, 2023 14:51
@brprice brprice force-pushed the brprice/benchmark-edits branch 2 times, most recently from 9be5b4c to 7558d8b Compare February 14, 2023 15:45
@brprice brprice force-pushed the brprice/benchmark-edits branch from 191cfa8 to 976c3f5 Compare February 21, 2023 14:28
@brprice brprice requested a review from a team February 21, 2023 14:31
Comment thread primer-benchmark/mkfixture/Main.hs Outdated
Comment thread primer-benchmark/src/Benchmarks.hs Outdated
Comment thread primer-service/exe-server/Main.hs
Copy link
Copy Markdown
Member

@dhess dhess left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good after all the cleanups, thanks!

@brprice brprice force-pushed the brprice/benchmark-edits branch 2 times, most recently from fa680aa to 9bf13e3 Compare February 22, 2023 16:16
This is to enable adding a benchmark of the edit-action handler.
We add these instances as setup for "replay fixtures", where we wish to
record a list of actions in a file and replay these as a benchmark. The
strategy is simple: we already log API calls, so we can extract actions
from primer's log; we simply need to be able to 'Read' them in from a
file.
To record fixtures to replay (for debugging or benchmarking), we
essentially want detailed logs. Currently our standard logs are verbose
enough to enable this, but this will not be true in the future. We
decouple these two uses, so (in future work) we can modify what we log
by default without breaking the workflow of recording fixtures.
@brprice brprice force-pushed the brprice/benchmark-edits branch from 9bf13e3 to f535eac Compare February 22, 2023 16:49
@brprice brprice added this pull request to the merge queue Feb 23, 2023
Merged via the queue into main with commit c44bee5 Feb 23, 2023
@brprice brprice deleted the brprice/benchmark-edits branch February 23, 2023 11:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants