-
Notifications
You must be signed in to change notification settings - Fork 1.9k
Improve benchmark docs #14820
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve benchmark docs #14820
Conversation
The command as written gives you `cargo` help, not `tpch` help as the text above says. And the output shown was for the benchmark bin, not the subcommand. Also correct some inconsistencies and punctuation.
alamb
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @carols10cents -- this looks good to me
I don't have any new benchmark to write to try these instructions out but they look good to me. Maybe @2010YOUY01 who recently added a benchmark could take a look at this one as well?
| section on adding a benchmark subcommand and add code to create or download data as part of its | ||
| `run` function. | ||
|
|
||
| If you want to create or download the data with shell commands, in `benchmarks/bench.sh`, define a |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thank you -- this content is great @carols10cents
I worry it will get out of sync being in a different file.
However, since it involves editing multiple files, I can't think of any place better to put it 🤔
|
I also just added a commit removing the sentence about commenting on a PR with |
I think it was done in |
|
Thanks again @carols10cents |
* Correct docs on subcommand help The command as written gives you `cargo` help, not `tpch` help as the text above says. And the output shown was for the benchmark bin, not the subcommand. Also correct some inconsistencies and punctuation. * Docs on how to add a new benchmark * Improve wording and punctuation in benchmarks README * Remove help text about /benchmark PR command that's disabled
Which issue does this PR close?
Rationale for this change
I added a new benchmark in #14818. There wasn't documentation on how to add a new benchmark (and some of the existing docs were wrong) so I wrote up what I did as I figured it out. I guessed a lot, so please correct me!
What changes are included in this PR?
New and improved docs!
Are these changes tested?
No, but I'd love to have someone try following the new docs to test if they're clear and helpful!
Are there any user-facing changes?
Nope!