Skip to content

Merge the benchmark fixes and enhancements to main#5437

Merged
ESadek-MO merged 10 commits intomainfrom
FEATURE_benchmarks
Aug 21, 2023
Merged

Merge the benchmark fixes and enhancements to main#5437
ESadek-MO merged 10 commits intomainfrom
FEATURE_benchmarks

Conversation

@trexfeathers
Copy link
Contributor

🚀 Pull Request

Description

Draft for now, as needs an extra What's New entry


Consult Iris pull request check list

* More sensible print and run functions.

* Avoid permanent modifications in _subprocess_runner.
* On demand benchmarking.

* Correct gh query.

* Correct assignee spacing.

* What's new entry.
* Don't check out head_ref - benchmark the GH simulated merge commit instead.

* What's New entry.
* Include a warning step for overnight benchmarking.

* Fix for failure warning script.

* Better formatting of warning issue title.

* What's new entry.
* Use shlex.split() for bm_runner commands.

* Minor documentation clarifications.
* Set benchmark runs to error if the subprocess errors.

* Still compare results even from a broken run.

* Still upload reports if overnight run fails.

* What's New entry.
* What's new entry.

* What's New entry.

* Hard-code conda channel into asv_delegated_conda.py .

* Fix some rebase confusion in the What's New.
* Inflate benchmark data to ensure laziness.

* What's New entry.
@trexfeathers trexfeathers added Type: Performance Type: Testing Type: Merge Back Merging a feature branch back to main labels Aug 18, 2023
@codecov
Copy link

codecov bot commented Aug 18, 2023

Codecov Report

Patch and project coverage have no change.

Comparison is base (368c2d8) 89.37% compared to head (5bda4e3) 89.37%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #5437   +/-   ##
=======================================
  Coverage   89.37%   89.37%           
=======================================
  Files          89       89           
  Lines       22443    22443           
  Branches     5381     5381           
=======================================
  Hits        20058    20058           
  Misses       1639     1639           
  Partials      746      746           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

* What's new entry.

* Correct user name @ESadek-MO.

* Missing colon.
@trexfeathers trexfeathers marked this pull request as ready for review August 18, 2023 15:01
Copy link
Contributor

@ESadek-MO ESadek-MO left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @trexfeathers! Cool to see this go in!

@ESadek-MO ESadek-MO merged commit ff897eb into main Aug 21, 2023
@ESadek-MO ESadek-MO deleted the FEATURE_benchmarks branch August 21, 2023 08:46
@trexfeathers
Copy link
Contributor Author

Many thanks @ESadek-MO 🙂

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Type: Merge Back Merging a feature branch back to main Type: Performance Type: Testing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants