Skip to content

Conversation

@atravitz
Copy link
Contributor

@atravitz atravitz commented Oct 14, 2025

In conversation with @ethanholz, we discussed running CI for branches that start with feat/, so that we can use CI for feature branches that might have many smaller PRs going into them.

Also, I'm proposing that we don't auto-run CI for PRs in draft-mode to save the rainforest.

Checklist

  • Added a news entry

Developers certificate of origin

@atravitz atravitz requested a review from mikemhenry October 14, 2025 20:46
@mikemhenry
Copy link
Contributor

mikemhenry commented Oct 14, 2025

+1 to the feat rule (we need to document this somewhere)

-1 to not running CI on draft PRs, at least without someway to running them via a label or comment. I like to use draft PRs to mean "this isn't ready yet for review" not "don't run CI on this". Sometimes I am not ready for review but I do want to see if it passes CI. But there are times when I don't want to run CI on a PR so I think in a perfect world if I could have a label that I can add to a draft PR that kicks off CI, that would be grand (and the label is a no op when the PR isn't in draft mode)

@ethanholz
Copy link
Collaborator

I agree with Mike, running on draft PRs often helps to inform when I should request a review. If things are looking green, that's a good sign that I am actually ready to have this seriously looked at.

@atravitz
Copy link
Contributor Author

+1 to the feat rule (we need to document this somewhere)

feat/ rule documented in this draft of contributing guidelines: #1580.
I plan to update the PR and issue templates as well soon.

-1 to not running CI on draft PRs, at least without someway to running them via a label or comment. I like to use draft PRs to mean "this isn't ready yet for review" not "don't run CI on this". Sometimes I am not ready for review but I do want to see if it passes CI. But there are times when I don't want to run CI on a PR so I think in a perfect world if I could have a label that I can add to a draft PR that kicks off CI, that would be grand (and the label is a no op when the PR isn't in draft mode)

This is a good point, are you saying "don't run tests on drafts by default, but add a comment or label that overrides it and turns on testing"?

Copy link
Member

@IAlibay IAlibay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Feels like there was a discussion somewhere about best prapctices that I didn't look at. I don't want to block, but at the same time I have a lot of questions.

paths-ignore:
- "docs/*"
- ".readthedocs.yaml"
types: [ready_for_review] # don't run for draft PRs
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See my comment in #1580, also in my opinion this discourages the use of draft PRs. If I open a draft PR, I also want to run CI to see what happens.

If we're concerned about running CI too much on draft, then we should just reduce the number of CI runners we run (we don't need to run codecov for every flavour of Python, and we have way too many CI runner types).

pull_request:
branches:
- main
- 'feat/**'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why just feat? I often write fixes going into other PRs that would need CI to run on them.

@mikemhenry
Copy link
Contributor

This is a good point, are you saying "don't run tests on drafts by default, but add a comment or label that overrides it and turns on testing"?

Yes, but only if there is some push for not wanting to run CI on drafts b/c it is an obvious waste and most of the time, the author of the PR didn't care about CI while in draft mode.

@atravitz atravitz changed the title run CI workflows for feat/ branches, and don't run for draft PRs run CI workflows for feat/ branches Nov 25, 2025
@github-actions
Copy link

No API break detected ✅

@atravitz
Copy link
Contributor Author

addressed by github.com//issues/1649

@atravitz atravitz closed this Nov 25, 2025
@atravitz atravitz deleted the ci/update_rules branch November 25, 2025 16:37
@codecov
Copy link

codecov bot commented Nov 25, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 93.01%. Comparing base (f0f968f) to head (c6ac173).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1579      +/-   ##
==========================================
- Coverage   95.41%   93.01%   -2.41%     
==========================================
  Files         185      185              
  Lines       16045    16045              
==========================================
- Hits        15310    14924     -386     
- Misses        735     1121     +386     
Flag Coverage Δ
fast-tests 93.01% <ø> (?)
slow-tests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants