Skip to content

Conversation

@dstandish
Copy link
Contributor

@dstandish dstandish commented May 9, 2023

When we tail stdout over kube API, we get ansi color codes which must be escaped in order for timestamps to be properly parsed so that messages can be properly interleaved by the file task handler (i.e. / a.k.a. the web UI task log reader).

While at it, fixed an issue with improper appending of "messages" (e.g. "fetching logs from kube API") and added one such message for good measure.

Before:
image

After:
image

@dstandish dstandish requested a review from jedcunningham as a code owner May 9, 2023 23:14
@boring-cyborg boring-cyborg bot added provider:cncf-kubernetes Kubernetes (k8s) provider related issues area:logging area:Scheduler including HA (high availability) scheduler labels May 9, 2023
@dstandish dstandish requested review from jedcunningham and removed request for jedcunningham May 9, 2023 23:14
@dstandish dstandish added this to the Airflow 2.6.1 milestone May 9, 2023
@dstandish dstandish requested a review from uranusjr May 10, 2023 17:58
dstandish added 3 commits May 10, 2023 13:14
When we tail stdout over kube API, we get ansi color codes which must be escaped in order for timestamps to be properly parsed so that messages can be properly interleaved by the file task handler (i.e. / a.k.a. the web UI task log reader).

While at it, fixed an issue with improper appending of "messages" (e.g. "fetching logs from kube API") and added one such message for good measure.
@dstandish dstandish force-pushed the k8s-executor-log-fetch-timestamp-parse-fix branch from 9b25182 to d015efb Compare May 10, 2023 20:14
@uranusjr uranusjr merged commit 86d62d3 into apache:main May 11, 2023
@uranusjr uranusjr deleted the k8s-executor-log-fetch-timestamp-parse-fix branch May 11, 2023 01:56
@ephraimbuddy ephraimbuddy added the type:bug-fix Changelog: Bug Fixes label May 11, 2023
ephraimbuddy pushed a commit that referenced this pull request May 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:logging area:Scheduler including HA (high availability) scheduler provider:cncf-kubernetes Kubernetes (k8s) provider related issues type:bug-fix Changelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants