Make benchmark output (stdout) more readable #102
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This uses numpy to print the most important information about the benchmark run to stdout:
I moved the
-m scorepout toscorep_settingsso they are shown in the script summary. It also makes the code easier as only 1 param for enabling has to be passed:-m scorepand the settings instead of a bool and a potentially empty list which is ignored if that bool is falseExample output (part) looks like this:
(The zeros are because I commented out the actual invocation)
As you can see the output is directly usable for further analysis or at least provides a quick answer on how fast it is. This works well with #101 which allows to selectively run 1 or more test configurations
The width of the repetitions (first number) is automatically determined from the maximum value so all are right aligned for easier comparison. Example: