Skip to content

Conversation

@obarisk
Copy link
Contributor

@obarisk obarisk commented Aug 23, 2024

ephraimbuddy and others added 30 commits August 9, 2024 08:32
We should recommend that users reserialize DAGs after finishing their
downgrades - the older version may have a different representation and
can cause odd failures.
…ache#41354)

* Update the contributing doc now that the main branch is Airflow 3

The main branch is now Airflow 3. We need to update the contributing docs
so contributors know where to PR against.

* fixup! Update the contributing doc now that the main branch is Airflow 3

* Apply suggestions from code review

Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>

---------

Co-authored-by: Kaxil Naik <kaxilnaik@gmail.com>
Co-authored-by: Tamara Janina Fingerlin <90063506+TJaniF@users.noreply.github.com>
…41298)

* Attempt to fix TriggerDagRunOperator for Database Isolation Tests

* Finalize making tests run for triggerdagrunoperator in db isolation mode

* Adjust query count assert for adjustments to serialization

* Review feedback
…#40008)

* init cloud_run service hook & operator

* init docs

* added example_cloud_run_service

* remove parent init

Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>

* apply reveiw - more clearer

* typo

* add ENV_ID in system tests

* validate inputs

* add deleteOperator & test

* typo

* modified second review

* 404/409 case in operator

* pass static checks

* typo

* modified service creation in hook & operator

* fixed by reviews in tests

* modified docs

* fixed test code to success

* modified hook

* add exceptions

* modified test codes

* static checks

---------

Co-authored-by: Shahar Epstein <60007259+shahar1@users.noreply.github.com>
…pache#40912)

* Chart: add a specific internal IP address for the ClusterIP service

* Chart: Fix values schema for clusterIP in PgBouncer Service

* Add unit-test for static ip in pgbouncer service

* Fix typo in pgbouncer template

* Fix static checks

* Change name of ip to clusterIp in pgbouncer service

* Fix helm tests for pgbouncer
…pache#41369)

* Skip core tests from start to SkipMixin for Database Isolation Mode

* Skip core tests from start to SkipMixin for Database Isolation Mode, uups

* Skip core tests from start to SkipMixin for Database Isolation Mode, uups
…ty (apache#41382)

When using older FAB providers on the new airflow, this function is called
in the old provider and is no longer available in the new airflow. This
PR brings this back to fix issue in main and v2-10-test branch where all
DAGs fail because of lack of this function
…ests (apache#41370)

Fixing remaining Variable tests for db isolation mode, also fixing secret backend haven't called from EnvironmentVariablesBackend, Metastore and custom ones. This caused side effect to move the Variable.get() method to internal API
…che#41387)

* Pass serialized parameter for dag_maker

* Serialisation of object is on __exit__ moving out the dag definition out of dag_maker context
Apparently constraints generation in 4 parallel docker containers causes
"no space left on device" error for public runners. This one limits
parallelism to 3 to limit disk usage
The `use_task_execution_day` param is deprecated
It is replaced by `airflow.sensors.external_task.ExternalDagLink`
The ``airflow.models.taskMixin.TaskMixin`` class has been removed. It was previously
deprecated in favor of the ``airflow.models.taskMixin.DependencyMixin`` class.
* spark kubernetes operator arguments description reordering

* spark kubernetes operator arguments description reordering
The test has been updated for DB isolation but the retrieval of
task was not intuitive and it could lead to flaky tests possibly
uranusjr and others added 5 commits August 22, 2024 14:27
Logging can convert an arbitrary object into a string by itself, so we
don't need to call str() eagerly. This can be a bit faster, and more
importantly, preserve as much context as possible for the logging stack
to extract if needed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:API Airflow's REST/HTTP API area:dev-tools area:production-image Production image improvements and fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.