Skip to content

Support the "magic loop" with Task SDK #45693

@kaxil

Description

@kaxil

Support https://airflow.apache.org/docs/apache-airflow/stable/howto/dynamic-dag-generation.html#optimizing-dag-parsing-delays-during-execution with Task SDK

log = structlog.get_logger(logger_name="task")
# TODO: set the "magic loop" context vars for parsing
ti = parse(msg)
log.debug("DAG file parsed", file=msg.dag_rel_path)

Metadata

Metadata

Assignees

Type

No type

Projects

Status

Done

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions