Skip to content

Conversation

@kaxil
Copy link
Member

@kaxil kaxil commented Oct 10, 2024

closes #42856 | Part of AIP-72 - Task Execution Interface and SDK

This PR adds a skeleton project for AIP-72 Task SDK

It creates this new project, integrates them to breeze & runs it on CI.

The code & tests are just placeholders at this point, we will start adding things needs for DAG Authors in separate PRs.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@kaxil kaxil added the area:task-execution-interface-aip72 AIP-72: Task Execution Interface (TEI) aka Task SDK label Oct 10, 2024
@kaxil kaxil force-pushed the add-task-sdk branch 5 times, most recently from 13ed85f to 68fb21b Compare October 10, 2024 21:08
@kaxil kaxil force-pushed the add-task-sdk branch 4 times, most recently from 42be114 to efc5128 Compare October 12, 2024 03:45
closes apache#42856

This PR adds a skeleton project for [AIP-72 Task SDK](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-72+Task+Execution+Interface+aka+Task+SDK)

It creates this new project, integrates them to breeze & runs it on CI.

The code & tests are just placeholders at this point, we will start adding things needs for DAG Authors in separate PRs.
@kaxil kaxil marked this pull request as ready for review October 12, 2024 13:55
@kaxil kaxil merged commit 4cd1e7d into apache:main Oct 12, 2024
@kaxil kaxil deleted the add-task-sdk branch October 12, 2024 14:40
kunaljubce pushed a commit to kunaljubce/airflow that referenced this pull request Oct 13, 2024
closes apache#42856

This PR adds a skeleton project for [AIP-72 Task SDK](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-72+Task+Execution+Interface+aka+Task+SDK)

It creates this new project, integrates them to breeze & runs it on CI.

The code & tests are just placeholders at this point, we will start adding things needs for DAG Authors in separate PRs.
@rawwar
Copy link
Contributor

rawwar commented Oct 13, 2024

@kaxil , This change is causing mypy pre-commit check to fail with following error:

task_sdk/tests/conftest.py:26: error: Incompatible types in assignment
(expression has type "tuple[()]", target has type "Union[str, list[str]]") 
[assignment]
        config.inicfg["airflow_deprecations_ignore"] = ()

Should the value be an empty string?

Or, I see in other places, we use # type: ignore[assignment,operator] comment.

Edit: Raised this PR to fix: #42976

@potiuk
Copy link
Member

potiuk commented Oct 14, 2024

Nice!

pavansharma36 pushed a commit to pavansharma36/airflow that referenced this pull request Oct 14, 2024
closes apache#42856

This PR adds a skeleton project for [AIP-72 Task SDK](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-72+Task+Execution+Interface+aka+Task+SDK)

It creates this new project, integrates them to breeze & runs it on CI.

The code & tests are just placeholders at this point, we will start adding things needs for DAG Authors in separate PRs.
R7L208 pushed a commit to R7L208/airflow that referenced this pull request Oct 17, 2024
closes apache#42856

This PR adds a skeleton project for [AIP-72 Task SDK](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-72+Task+Execution+Interface+aka+Task+SDK)

It creates this new project, integrates them to breeze & runs it on CI.

The code & tests are just placeholders at this point, we will start adding things needs for DAG Authors in separate PRs.
harjeevanmaan pushed a commit to harjeevanmaan/airflow that referenced this pull request Oct 23, 2024
closes apache#42856

This PR adds a skeleton project for [AIP-72 Task SDK](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-72+Task+Execution+Interface+aka+Task+SDK)

It creates this new project, integrates them to breeze & runs it on CI.

The code & tests are just placeholders at this point, we will start adding things needs for DAG Authors in separate PRs.
PaulKobow7536 pushed a commit to PaulKobow7536/airflow that referenced this pull request Oct 24, 2024
closes apache#42856

This PR adds a skeleton project for [AIP-72 Task SDK](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-72+Task+Execution+Interface+aka+Task+SDK)

It creates this new project, integrates them to breeze & runs it on CI.

The code & tests are just placeholders at this point, we will start adding things needs for DAG Authors in separate PRs.
ellisms pushed a commit to ellisms/airflow that referenced this pull request Nov 13, 2024
closes apache#42856

This PR adds a skeleton project for [AIP-72 Task SDK](https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-72+Task+Execution+Interface+aka+Task+SDK)

It creates this new project, integrates them to breeze & runs it on CI.

The code & tests are just placeholders at this point, we will start adding things needs for DAG Authors in separate PRs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:task-execution-interface-aip72 AIP-72: Task Execution Interface (TEI) aka Task SDK

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Create airflow-sdk dist containing DAG definition level code

4 participants