-
Notifications
You must be signed in to change notification settings - Fork 16.4k
Parametrize poll_interval in KubernetesPodOperator #32631
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Parametrize poll_interval in KubernetesPodOperator #32631
Conversation
|
@stelsemeyer-m60 Why was this closed? Is it not applicable anymore? |
This is a duplicate of #31008, with a pending discussion. |
|
I see. The PR was closed due to no activity. How do you plan to follow up on it? |
Would be great to get feedback on my last reply (in that PR). Otherwise I can also make an educated guess/decision. My time is limited at the moment, but I still plan to finish that PR. |
Small uggestion - in case it is not clear @stelsemeyer-m60: I suggest (and our CONTRIBUTING docs already explain that) to regular (but not too frequent - use your own judgment taking into account that people look at those in their private time and can be busy/on holidays etc.) gently pinging when you wait for answer. It's SUPER easy to miss someone's question or explanation, and when you take into accounts that we merge 30-40 PRs a day and have 150 opened PRs and many more issues commented on, the fact that you asked a question might be easily missed. If you look at this from the other side - you have one PR that you care about and maintainers have at the same time 100s of conversations going on, it's quite a bit obvious that it's on the side of author to make sure to follow up if they want to make things happen :). This also shows that you do, actually care, and have not abandoned it (which happens more often than you think). Just a friendly tip. |
Absolutely understandable. Thanks for outlining this, and the tip, @potiuk. I should have checked CONTRIBUTING doc more carefully. Sometimes mature open source projects are a bit overwhelming, especially when you just want to make a small adjustment that you feel is fair and without risk. Anyways, that shall not be an excuse but maybe rather an additional perspective. I totally get your point and you are absolutely right. I will follow up on the ticket and go ahead as you suggested. |
Parametrize the interval in which the Kubernetes pod status is polled when launching a new pod using the already existing
poll_intervalparameter.When using serverless Kubernetes services like Google GKE Autopilot the pod startup time is sometimes expected to be longer due to a cold start. Therefore the logs might be spammed due to the default checks every second (see below), and a lower check frequency might be desired
This addresses comments in #31008 (having duplicated logic, not fully functional new implementation).
cc @jedcunningham @potiuk