Skip to content

Conversation

@dstandish
Copy link
Contributor

@dstandish dstandish commented May 5, 2023

Generally speaking when a task is done we should not read from logs server, because we assume for log persistence that users will either set up shared drive or enable remote logging. But if they don't do that, and therefore we don't find remote or local logs, we'll check worker for served logs as a fallback.

Resolves #31059
Possibly related #30997
Resolves #31083

…s found

Generally speaking when a task is done we should not read from logs server, because we assume for log persistence that users will either set up shared drive or enable remote logging.  But if they don't do that, and therefore we don't find remote or local logs, we'll check worker for served logs as a fallback.
@potiuk
Copy link
Member

potiuk commented May 5, 2023

But just to warn you - I am up to refactoring that one soon as soon as we get out of the "let's fix teething problems of 2.6.0" mode :)

@dstandish
Copy link
Contributor Author

But just to warn you - I am up to refactoring that one soon as soon as we get out of the "let's fix teething problems of 2.6.0" mode :)

I'm eager to help with it!

@potiuk potiuk linked an issue May 6, 2023 that may be closed by this pull request
2 tasks
Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
@dstandish dstandish merged commit 672ee7f into apache:main May 8, 2023
@dstandish dstandish deleted the ensure-served-logs-checked-when-no-local-no-remote branch May 8, 2023 21:51
@dstandish dstandish modified the milestones: Airflow 2.6.2, Airflow 2.6.1 May 8, 2023
@ephraimbuddy ephraimbuddy added the type:bug-fix Changelog: Bug Fixes label May 9, 2023
ephraimbuddy pushed a commit that referenced this pull request May 9, 2023
…s found (#31101)

Generally speaking when a task is done we should not read from logs server, because we assume for log persistence that users will either set up shared drive or enable remote logging.  But if they don't do that, and therefore we don't find remote or local logs, we'll check worker for served logs as a fallback.

Co-authored-by: Jed Cunningham <66968678+jedcunningham@users.noreply.github.com>
(cherry picked from commit 672ee7f)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:logging type:bug-fix Changelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Logs no longer shown after task completed CeleryExecutor Can not get more logs of DAGS on UI when deploy on Kubernetes

5 participants