Skip to content

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Dec 2, 2023

This change codifies and explains assumptions and decisions made by Airflow maintainers with regards to capabilities of DAG Authors.

While DAG authors are pretty powerful and capable actors in Airflow, they cannot do everything and Deployment Managers have ways to restrict their potential capabilities, especially in the context of influencing other tasks and common components such as Scheduler, Webserver and Triggerer.

This PR adds a chapter explaining those assumptions and decisions and tell the Deployment Managers what responsibilities they have with that regards and what mechanisms they currently have available to limit capabilities of DAG Authors.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm working on moving the new priority weight strategy to a plugin, I will update this part once I finish my PR.

Copy link
Member Author

@potiuk potiuk Dec 2, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perfect :) . I was just asking in the original PR #35210

@potiuk potiuk added this to the Airflow 2.8.0 milestone Dec 2, 2023
@potiuk potiuk force-pushed the add-explanation-about-running-dag-author-code-in-scheduler branch from cc4f7b0 to 59e38a7 Compare December 2, 2023 12:46
Copy link
Member

@pankajkoti pankajkoti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is very helpful!

@potiuk potiuk force-pushed the add-explanation-about-running-dag-author-code-in-scheduler branch from dafefdf to e231047 Compare December 3, 2023 23:31
potiuk and others added 3 commits December 4, 2023 10:21
This change codifies and explains assumptions and decisions made by
Airflow maintainers with regards to capabilities of DAG Authors.

While DAG authors are pretty powerful and capable actors in Airflow,
they cannot do everything and Deployment Managers haw ways to restrict
their potential capabilities, especially in the context of influencing
other tasks and common components such as Scheduler, Webserver and
Triggerer.

This PR adds a chapter explaining those assumptions and decisions and
tell the Deployment Managers what responsibilities they have with
that regardsm and what mechanismes they currently have available to
limit capabilities of DAG Authors.
Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com>
Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com>
@potiuk potiuk force-pushed the add-explanation-about-running-dag-author-code-in-scheduler branch from c2aa0ba to f11afb8 Compare December 4, 2023 09:21
@potiuk
Copy link
Member Author

potiuk commented Dec 4, 2023

I will merge it as is now, and we can update it later @hussein-awala :)

@potiuk potiuk merged commit 395ac46 into apache:main Dec 4, 2023
@potiuk potiuk deleted the add-explanation-about-running-dag-author-code-in-scheduler branch December 4, 2023 10:07
@ephraimbuddy ephraimbuddy added the type:doc-only Changelog: Doc Only label Dec 5, 2023
ephraimbuddy pushed a commit that referenced this pull request Dec 5, 2023
…ies (#36022)

* Add the section describing the security model of DAG Author capabilities

This change codifies and explains assumptions and decisions made by
Airflow maintainers with regards to capabilities of DAG Authors.

While DAG authors are pretty powerful and capable actors in Airflow,
they cannot do everything and Deployment Managers haw ways to restrict
their potential capabilities, especially in the context of influencing
other tasks and common components such as Scheduler, Webserver and
Triggerer.

This PR adds a chapter explaining those assumptions and decisions and
tell the Deployment Managers what responsibilities they have with
that regardsm and what mechanismes they currently have available to
limit capabilities of DAG Authors.

* Update docs/apache-airflow/security/security_model.rst

Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com>

* Update docs/apache-airflow/security/security_model.rst

Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com>

---------

Co-authored-by: Pankaj Koti <pankajkoti699@gmail.com>
(cherry picked from commit 395ac46)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants