Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
158 commits
Select commit Hold shift + click to select a range
a6704d0
Update 2.5.0 release date (#28081)
ephraimbuddy Dec 3, 2022
5012093
Allow generation of connection URI to work when no conn type (#26765)
dstandish Dec 30, 2022
39791b6
fix: continue checking sla (#26968)
doiken Dec 14, 2022
5a565c4
Additional info about Segmentation Fault in LocalTaskJob (#27381)
Taragolis Dec 4, 2022
f8db720
Handle DAG disappearing mid-flight when dag verification happens (#27…
potiuk Nov 27, 2022
7a03761
Note which versions of Python are supported (#27798)
bertiewooster Nov 27, 2022
d174ef1
dagrun, next_dagruns_to_examine, add MySQL index hint (#27821)
michaelmicheal Nov 25, 2022
d34bd50
Make sure we can get out of a faulty scheduler state (#27834)
stijndehaes Dec 5, 2022
dcb9d47
Don't log CLI actions if db not initialized (#27851)
dstandish Dec 3, 2022
cc02bdc
fix: current_state method on TaskInstance doesn't filter by map_index…
xlanor Dec 3, 2022
5302cc2
Order TIs by map_index (#27904)
tanelk Dec 5, 2022
9733de8
Fix deadlock when chaining multiple empty mapped tasks (#27964)
ephraimbuddy Nov 29, 2022
5bb6430
Documentation for the LocalTaskJob return code counter (#27972)
IKholopov Nov 28, 2022
9aa72e4
Ignore Blackification commit from Git Blame (#27981)
uranusjr Nov 29, 2022
2016d4a
Simplify dataset subgraph logic (#27987)
bbovenzi Nov 30, 2022
7646bf6
Prevent double loading of providers from local paths (#27988)
ashb Nov 29, 2022
be004cb
Add documentation for [core] mp_start_method config (#27993)
csm10495 Nov 30, 2022
e573389
docs: copyedit DAG (#27995)
dandv Nov 30, 2022
3f3fd0f
Handle bad zip files nicely when parsing DAGs. (#28011)
potiuk Nov 30, 2022
c5a0a6b
Use asserts instead of exceptions for executor not started (#28019)
dstandish Dec 2, 2022
b322572
Add Andrey as committer (#28050)
potiuk Dec 2, 2022
51791a8
Return list of tasks that will be changed (#28066)
atrbgithub Dec 5, 2022
dacc8fc
Resolve false warning about calling conf.get on moved item (#28075)
dstandish Dec 2, 2022
7c916b7
Bump decode-uri-component from 0.2.0 to 0.2.2 in /airflow/www (#28080)
dependabot[bot] Dec 5, 2022
780a028
Add airflow.api.auth.backend.session to backend sessions in compose (…
potiuk Dec 4, 2022
4c15384
Improve handling of warnings in CI (#28096)
potiuk Dec 4, 2022
b4efb30
Don't emit FutureWarning when code not calling old key (#28109)
dstandish Dec 6, 2022
2bc0a0d
Make BaseJob.most_recent_job favor "running" jobs (#28119)
kosteev Dec 7, 2022
a7bcb4b
Improve run/task grid view actions (#28130)
bbovenzi Dec 6, 2022
b7f6d0c
Ensure the dagbag_size metric decreases when files are deleted (#28135)
ashb Dec 6, 2022
1011296
Do not warn when airflow dags tests command is used (#28138)
potiuk Dec 6, 2022
524004e
Ensure that warnings from `@dag` decorator are reported in dag file (…
ashb Dec 6, 2022
824963a
fix next run datasets error (#28165)
bbovenzi Dec 6, 2022
2bfc020
Make invalid characters exception more readable (#28181)
uranusjr Dec 7, 2022
d69af8e
Fix typo in Best Practice documentation (#28190)
pruoff Dec 7, 2022
fa37bf7
Add custom pickling hooks to LazyXComAccess (#28191)
uranusjr Dec 15, 2022
e21a315
Make live logs reading work for "other" k8s executors (#28213)
dstandish Dec 8, 2022
68a0fb7
Make arguments 'offset' and 'length' not required (#28234)
malthe Dec 9, 2022
9220218
Fix db clean warnings (#28243)
jedcunningham Dec 9, 2022
805dbc2
Convert test_task_command to Pytest and unquarantine tests in it (#28…
potiuk Dec 9, 2022
2150114
Trigger gevent monkeypatching via environment variable (#28283)
potiuk Dec 21, 2022
7f06509
Add SIGUSR2 handler for LocalTaskJob and workers to aid debugging (#2…
ashb Dec 12, 2022
4edd588
Separate ER diagram dependencies to doc_gen extra (#28346)
potiuk Dec 13, 2022
3a8768e
Remove docs package from Publish_docs.py and switch to python in sheb…
potiuk Dec 13, 2022
2653349
Correctly select a mapped task's "previous" task (#28379)
uranusjr Dec 15, 2022
97f7de2
Maintain manual scroll position in task logs (#28386)
bbovenzi Dec 19, 2022
ae49fcf
Dont show task/run durations when there is no start_date (#28395)
bbovenzi Dec 16, 2022
cf966c8
A manual run can't look like a scheduled one (#28397)
uranusjr Dec 22, 2022
d3824d5
separate callModal from dag.js (#28410)
bbovenzi Dec 22, 2022
b82f5af
Fix ti._try_number for deferred and up_for_reschedule tasks (#26993)
bbovenzi Jan 5, 2023
17fc92f
Add setters to MappedOperator on_*_callbacks (#28313)
cccs-seb Dec 13, 2022
3113f89
Re-enable Plyvel on ARM as it now builds cleanly (#28443)
potiuk Dec 18, 2022
4657a63
Add `ensure_ascii=False` in trigger dag run API (#28451)
akakakakakaa Dec 19, 2022
c57c7fc
Fix example import sentence in dates.py (#28453)
xyc-pz Dec 19, 2022
cf38e27
Fix bad pods pickled in executor_config (#28454)
dstandish Dec 26, 2022
d18367b
Ensure correct log dir in file task handler (#28477)
pingzh Jan 6, 2023
df1d322
Add retry to purge_inactive_dag_warnings (#28481)
michaelmicheal Jan 5, 2023
8157c0b
Move MyPY plugins of ours to dev folder (#28498)
potiuk Dec 20, 2022
505cfc4
Remove outdated Optional Provider Feature outdated documentation (#28…
potiuk Dec 20, 2022
f0625d4
Add AIRFLOW_PROJ_DIR to docker-compose example (#28517)
kfirgollan Dec 22, 2022
70f8ee3
Add MSSQL support for ARM Docker images (#28533)
potiuk Dec 22, 2022
287dd0d
Consider previous run in CronTriggerTimetable (#28532)
uranusjr Dec 26, 2022
2a34ec4
Emit warnings for `conf.get*` from the right source location (#28543)
ashb Dec 30, 2022
ccbdab8
navbar, cap dropdown size, and add scroll bar (#28561)
michaelmicheal Dec 30, 2022
21e6df8
Move TI setNote endpoints under TaskInstance in OpenAPI (#28566)
jedcunningham Dec 23, 2022
9a4645f
Update baseoperator.py (#28574)
abouklila Dec 29, 2022
80e7dec
Guard not-yet-expanded ti in trigger rule dep (#28592)
uranusjr Dec 28, 2022
cb2435e
Fix ``Connection.get_extra`` type (#28594)
bravmi Dec 28, 2022
2edf3ba
Use docker compose v2 command (#28605)
aaronsatae Dec 27, 2022
652c6ac
Fix Incorrect Example (#28609)
jfallt Dec 28, 2022
274304f
Minor update to Scheduler documentation (#28620)
maxnathaniel Dec 28, 2022
a4fef1f
Fix code docstrings (#28622)
stamixthereal Dec 28, 2022
9581691
Fix typo (#28623)
jbampton Dec 28, 2022
c442215
Fix UI caret direction (#28624)
vchiapaikeo Jan 2, 2023
73169bf
Add doc-strings and small improvement to email util (#28634)
stamixthereal Dec 29, 2022
e3bce86
Nest header blocks in divs to fix dagid copy nit on dag.html (#28643)
vchiapaikeo Jan 4, 2023
922963f
Remove outdated comments from base hook (#28649)
pankajastro Dec 30, 2022
7e34004
Fix `DetachedInstanceError` when finding zombies in Dag Parsing proce…
BobDu Dec 22, 2022
8b5ce05
Adding an example dag for dynamic task mapping (#28325)
amoghrajesh Dec 15, 2022
c18fe56
After running the DAG the employees table is empty. (#28353)
avicol Jan 11, 2023
214a2ff
Fix calendar view for CronTriggerTimeTable dags (#28411)
bbovenzi Dec 28, 2022
319234b
Improve provider validation pre-commit (#28516)
potiuk Dec 22, 2022
0d42c51
Add back join to zombie query that was dropped in #28198 (#28544)
jedcunningham Dec 23, 2022
5d6b445
Update pre-commit hooks (#28567)
KarshVashi Dec 24, 2022
a910d39
Change Architecture and OperatingSystem classies into Enums (#28627)
potiuk Jan 2, 2023
c0145d0
Fix minor typo in taskflow.rst (#28656)
markhatch Dec 30, 2022
0468ee7
Fix description of output redirection for access_log for gunicorn (#2…
potiuk Jan 3, 2023
6a6a258
Handle ConnectionReset exception in Executor cleanup (#28685)
maxnathaniel Jan 3, 2023
064c5c8
Fixed typo (#28687)
adilkhash Jan 3, 2023
d213afb
Row-lock TIs to be removed during mapped task expansion (#28689)
ephraimbuddy Jan 4, 2023
2528a5b
Allow XComArgs for external_task_ids of ExternalTaskSensor (#28692)
vchiapaikeo Jan 4, 2023
b4d65eb
Fix "airflow tasks render" cli command for mapped task instances (#28…
ephraimbuddy Jan 4, 2023
b33b87e
Fix some docs on using sensors with taskflow (#28708)
csm10495 Jan 4, 2023
329aad6
Add Niko to committers (#28712)
jedcunningham Jan 4, 2023
694c8c0
Bump json5 from 1.0.1 to 1.0.2 in /airflow/www (#28715)
dependabot[bot] Jan 4, 2023
65ea160
Ignore Blackification commit from Blame (#28719)
uranusjr Jan 4, 2023
4264401
Limit SQLAlchemy to below 2.0 (#28725)
potiuk Jan 4, 2023
e70f640
Clarify about docker compose (#28729)
eladkal Jan 4, 2023
62d5e47
Update CSRF token to expire with session (#28730)
maxnathaniel Jan 10, 2023
44dc2d8
Clarify that versioned constraints are fixed at release time (#28762)
potiuk Jan 6, 2023
589c83b
Only patch single label when adopting pod (#28776)
jedcunningham Jan 10, 2023
2f0916e
Fix UIAlert should_show when AUTH_ROLE_PUBLIC set (#28781)
vchiapaikeo Jan 10, 2023
e659595
Remove swagger-ui extra from connexion and install swagger-ui-dist vi…
JGoldman110 Jan 10, 2023
292592c
Update dynamic-task-mapping.rst (#28797)
sadler-elena Jan 9, 2023
7b3d591
Fix masking of non-sensitive environment variables (#28802)
ephraimbuddy Jan 9, 2023
116ca05
Update scheduler docs about low priority tasks (#28831)
eladkal Jan 11, 2023
7e9467f
Fix taskflow.rst duplicated "or" (#28839)
itaymaslo Jan 11, 2023
92235e1
Update config hash in Breeze's README.md during reinstalllation (#28148)
potiuk Dec 6, 2022
06807b2
Add inputimeout as dependency to breeze-cmd-line pre-commit deps (#28…
potiuk Dec 12, 2022
d3aeea6
Show mapped task groups in graph (#28392)
bbovenzi Dec 19, 2022
825fdf3
Only get changelog for core commits (#27900)
ephraimbuddy Nov 24, 2022
ab37ae5
Strip provider test details for mssql tests in CI (#27938)
potiuk Nov 26, 2022
bf41ca4
Make updating breeze deps via breeze easier. (#27958)
ashb Nov 28, 2022
007414a
Make breeze SVG output more stable (#27960)
ashb Nov 28, 2022
8ad86bf
better warning messages when running breeze in rosetta (#27874)
vandonr-amz Nov 30, 2022
4f0ae0d
Fix UnboundLocalError in breeze (#28126)
turbaszek Dec 5, 2022
268fe7c
Check if ghcr.io is reachable before network-bound breeze operations …
potiuk Dec 5, 2022
1fa8f43
Summarize all warnings from all builds (#28151)
potiuk Dec 6, 2022
3909409
Don't check rosetta on i386 (#28169)
dstandish Dec 6, 2022
2fed158
Force higher parallelism for waiting for images in CI (#28209)
potiuk Dec 8, 2022
56d7651
Improve caching for pre-commits in CI (#28240)
potiuk Dec 9, 2022
9081910
Proper Python Host output from composite tasks in CI (#28254)
potiuk Dec 10, 2022
8073efc
Make sure the key for k8s environment changes with requirements in CI…
potiuk Dec 12, 2022
86eb97c
Selective checks for API did not match API test specification (#28319)
potiuk Dec 12, 2022
5607ba9
Remove postgres from K8S venv (#28323)
potiuk Dec 13, 2022
2c7ef41
Fix output of error in K8s venv installation (#28322)
potiuk Dec 13, 2022
71d3060
Fix output buffering for `breeze testing test` (#28433)
potiuk Dec 18, 2022
b8efa4d
Fix redirection for selective chekcs for all workflows (#28518)
potiuk Dec 21, 2022
5eb90ef
Add VERBOSE equal to false for all just changed selective checks (#28…
potiuk Dec 21, 2022
f59105e
Re-enable `pymsql` on ARM as it now builds cleanly (#28530)
Taragolis Dec 22, 2022
c8a91a5
Wait for asset compilation to finish before starting airflow in Breez…
potiuk Dec 24, 2022
f9e535b
Output of the "dev" asset compilation for breeze available in file (#…
potiuk Dec 24, 2022
0df6a33
Allow to specify `pip` version via github URL in Docker/CI workflow (…
potiuk Jan 5, 2023
031c260
Add Andrey as allowed to use self-hosted runners (#28095)
potiuk Dec 4, 2022
93f9e1c
Fix selective checks handling error tracebacks in CI (#28514)
potiuk Dec 21, 2022
b7cf404
Remove deprecated AIPlatformConsoleLinkk from google/provider.yaml (#…
vchiapaikeo Dec 21, 2022
8dd1497
Fix tag_providers.sh (#28345)
eladkal Dec 13, 2022
d7db157
fIx isort problems introduced by recent isort release (#28434)
potiuk Dec 18, 2022
39a5d2f
Restructure Docs (#27235)
TohnJhomas Dec 16, 2022
c5d64ce
Cleanup and do housekeeping with plugin examples (#28537)
potiuk Dec 22, 2022
fafce07
Remove extra H1 & improve formatting of Listeners docs page (#28450)
nathan-contino Dec 19, 2022
c34ab42
Slightly improve description of Dynamic DAG generation preamble (#28650)
potiuk Dec 30, 2022
1a044ed
Added --integration flag to "standard" set of flags for testing comma…
potiuk Dec 9, 2022
3c885de
Add automated version replacement in example dag indexes (#28090)
potiuk Dec 5, 2022
369c635
Make secret rendering test more resilient to implementation details (…
potiuk Jan 2, 2023
1524392
Mention mapped operator in cluster policy doc (#28885)
uranusjr Jan 12, 2023
fb27486
Skip pushing early image cache for non-main branches (#28895)
potiuk Jan 12, 2023
6101280
Google have re-worked their docs site ane appear not publish objects.…
ashb Jan 10, 2023
e234beb
Validate Sphinx Inventory file header (#28838)
Taragolis Jan 10, 2023
743c237
fixup! Restructure Docs (#27235)
ephraimbuddy Jan 12, 2023
1208f4a
Rewrite kerberos security integration and unit tests (#28092)
Taragolis Dec 5, 2022
6c01117
Replace `unittests` in providers tests by pure `pytest` [Wave-3] (#27…
Taragolis Nov 26, 2022
dd14501
Replace `unittests` in providers-apache tests by pure `pytest` (#27948)
Taragolis Nov 27, 2022
d88aa5d
Move Integration tests to separate package under tests (#28170)
potiuk Dec 6, 2022
f78d285
Merge redis and rabbitmq integration into celery (#28205)
potiuk Dec 8, 2022
d879dde
Integration tests are separated into separate command and CI job (#28…
potiuk Dec 8, 2022
4ae8f42
Update Airflow version to 2.5.1
ephraimbuddy Jan 12, 2023
2ce4b56
Add Changelog for 2.5.1
ephraimbuddy Jan 12, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
1 change: 0 additions & 1 deletion .dockerignore
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,6 @@
!chart
!docs
!licenses
!metastore_browser

# Add those folders to the context so that they are available in the CI container
!scripts/in_container
Expand Down
4 changes: 3 additions & 1 deletion .git-blame-ignore-revs
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
# Black enabled on providers.
# Black enabled.
4e8f9cc8d02b29c325b8a5a76b4837671bdf5f68
fdd9b6f65b608c516b8a062b058972d9a45ec9e3

# PEP-563 (Postponed Evaluation of Annotations).
Expand All @@ -7,3 +8,4 @@ d67ac5932dabbf06ae733fc57b48491a8029b8c2
# Mass converting string literals to use double quotes.
2a34dc9e8470285b0ed2db71109ef4265e29688b
bfcae349b88fd959e32bfacd027a5be976fe2132
01a819a42daa7990c30ab9776208b3dcb9f3a28b
4 changes: 4 additions & 0 deletions .github/actions/breeze/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,10 @@
---
name: 'Setup Breeze'
description: 'Sets up Python and Breeze'
outputs:
host-python-version:
description: Python version used in host
value: ${{ steps.host-python-version.outputs.host-python-version }}
runs:
using: "composite"
steps:
Expand Down
6 changes: 6 additions & 0 deletions .github/actions/post_tests/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,12 @@ runs:
name: coverage-${{env.JOB_ID}}
path: ./files/coverage*.xml
retention-days: 7
- name: "Upload artifact for warnings"
uses: actions/upload-artifact@v3
with:
name: test-warnings-${{env.JOB_ID}}
path: ./files/warnings-*.txt
retention-days: 7
- name: "Fix ownership"
shell: bash
run: breeze ci fix-ownership
Expand Down
5 changes: 5 additions & 0 deletions .github/actions/prepare_breeze_and_image/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,11 +22,16 @@ inputs:
pull-image-type:
description: 'Which image to pull'
default: CI
outputs:
host-python-version:
description: Python version used in host
value: ${{ steps.breeze.outputs.host-python-version }}
runs:
using: "composite"
steps:
- name: "Install Breeze"
uses: ./.github/actions/breeze
id: breeze
- name: Pull CI image ${{ env.PYTHON_MAJOR_MINOR_VERSION }}:${{ env.IMAGE_TAG }}
shell: bash
run: breeze ci-image pull --tag-as-latest
Expand Down
21 changes: 10 additions & 11 deletions .github/boring-cyborg.yml
Original file line number Diff line number Diff line change
Expand Up @@ -67,8 +67,8 @@ labelPRBasedOnFilePath:
- airflow/kubernetes_executor_templates/**/*
- airflow/executors/kubernetes_executor.py
- airflow/executors/celery_kubernetes_executor.py
- docs/apache-airflow/executor/kubernetes.rst
- docs/apache-airflow/executor/celery_kubernetes.rst
- docs/apache-airflow/core-concepts/executor/kubernetes.rst
- docs/apache-airflow/core-concepts/executor/celery_kubernetes.rst
- docs/apache-airflow-providers-cncf-kubernetes/**/*
- kubernetes_tests/**/*

Expand All @@ -83,7 +83,6 @@ labelPRBasedOnFilePath:
- tests/www/api/**/*

area:dev-tools:
- airflow/mypy/**/*
- scripts/**/*
- dev/**/*
- .github/**/*
Expand Down Expand Up @@ -136,17 +135,17 @@ labelPRBasedOnFilePath:
- airflow/cli/**/*.py
- tests/cli/**/*.py
- docs/apache-airflow/cli-and-env-variables-ref.rst
- docs/apache-airflow/usage-cli.rst
- docs/apache-airflow/howto/usage-cli.rst

area:Lineage:
- airflow/lineage/**/*
- tests/lineage/**/*
- docs/apache-airflow/lineage.rst
- docs/apache-airflow/administration-and-deployment/lineage.rst

area:Logging:
- airflow/providers/**/log/*
- airflow/utils/log/**/*
- docs/apache-airflow/logging-monitoring/logging-*.rst
- docs/apache-airflow/administration-and-deployment/logging-monitoring/logging-*.rst
- tests/providers/**/log/*
- tests/utils/log/**/*

Expand All @@ -155,15 +154,15 @@ labelPRBasedOnFilePath:
- airflow/plugins_manager.py
- tests/cli/commands/test_plugins_command.py
- tests/plugins/**/*
- docs/apache-airflow/plugins.rst
- docs/apache-airflow/authoring-and-scheduling/plugins.rst

area:Scheduler/Executor:
- airflow/executors/**/*
- airflow/jobs/**/*
- airflow/task/task_runner/**/*
- airflow/dag_processing/**/*
- docs/apache-airflow/executor/**/*
- docs/apache-airflow/concepts/scheduler.rst
- docs/apache-airflow/core-concepts/executor/**/*
- docs/apache-airflow/administration-and-deployment/scheduler.rst
- tests/executors/**/*
- tests/jobs/**/*

Expand All @@ -172,14 +171,14 @@ labelPRBasedOnFilePath:
- airflow/providers/**/secrets/*
- tests/secrets/**/*
- tests/providers/**/secrets/*
- docs/apache-airflow/security/secrets/**/*
- docs/apache-airflow/administration-and-deployment/security/secrets/**/*

area:Serialization:
- airflow/serialization/**/*
- airflow/models/serialized_dag.py
- tests/serialization/**/*
- tests/models/test_serialized_dag.py
- docs/apache-airflow/dag-serialization.rst
- docs/apache-airflow/administration-and-deployment/dag-serialization.rst

area:core-operators:
- airflow/operators/**/*
Expand Down
3 changes: 2 additions & 1 deletion .github/workflows/build-images.yml
Original file line number Diff line number Diff line change
Expand Up @@ -151,7 +151,8 @@ jobs:
env:
PR_LABELS: "${{ steps.get-latest-pr-labels.outputs.pull-request-labels }}"
COMMIT_REF: "${{ env.TARGET_COMMIT_SHA }}"
run: breeze ci selective-check 2>> ${GITHUB_OUTPUT}
VERBOSE: "false"
run: breeze ci selective-check >> ${GITHUB_OUTPUT}
- name: env
run: printenv
env:
Expand Down
Loading