-
Notifications
You must be signed in to change notification settings - Fork 16.4k
Description
Body
I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?
Let us know in the comment, whether the issue is addressed.
Those are providers that require testing as there were some substantial changes introduced:
Provider amazon: 8.2.0rc1
- Add deferrable option to EmrTerminateJobFlowOperator (#31646): @syedahsn
- Add Deferrable option to EmrCreateJobFlowOperator (#31641): @syedahsn
- Add deferrable mode to
BatchSensor(#30279): @phanikumv - Add deferrable mode for S3KeySensor (#31018): @sunank200
- Add Deferrable mode to Emr Add Steps operator (#30928): @syedahsn
- Add deferrable mode in Redshift delete cluster (#30244): @pankajastro
- Add discoverability for triggers in provider.yaml (#31576): @eladkal
- Add deferrable mode to AWS glue operators (Job & Crawl) (#30948): @vandonr-amz
- Add deferrable param in BatchOperator (#30865): @pankajastro
- Add Deferrable Mode to RedshiftCreateClusterSnapshotOperator (#30856): @syedahsn
- Deferrable mode for EksCreateFargateProfileOperator and EksDeleteFargateProfileOperator (#31657): @syedahsn
- allow anonymous AWS access (#31659): @melugoyal
- Support of wildcard in S3ListOperator and S3ToGCSOperator (#31640): @moiseenkov
- Add
deferrableparam inEmrContainerSensor(#30945): @pankajastro - Add realtime container execution logs for BatchOperator (#31837): @killua1zoldyck
- Various fixes on ECS run task operator (#31838): @vandonr-amz
- fix return values on glue operators deferrable mode (#31694): @vandonr-amz
- Add back missing AsyncIterator import (#31710): @uranusjr
- Use a continuation token to get logs in ecs (#31824): @vandonr-amz
- Fetch status in while loop so as to not exit too early (#31804): @o-nikolas
- [AWS hook] use provided client to get the official waiter on fallback (#31748): @vandonr-amz
- fix(providers/amazon): handle missing LogUri in emr describe_cluster API response (#31482): @Lee-W
- Add Python 3.11 support (#27264): @potiuk
- Added config template field to EmrServerlessStartJobOperator (#31746): @mahammi
- Add null check for host in Amazon Redshift connection (#31567): @sunank200
- add workgroup to templated fields (#31574): @simonprydden
- Add docstring and signature for _read_remote_logs (#31623): @dstandish
- Deprecate
wait_for_completionfromEcsRegisterTaskDefinitionOperatorandEcsDeregisterTaskDefinitionOperator(#31884): @vandonr-amz - Change Deferrable implementation for RedshiftResumeClusterOperator to follow standard (#30864): @syedahsn
- Change Deferrable implementation for RedshiftPauseClusterOperator to follow standard (#30853): @syedahsn
Provider apache.hive: 6.1.1rc1
- Sanitize beeline principal parameter (#31983): @potiuk
- Replace unicodecsv with standard csv library (#31693): @dstandish
Provider apache.livy: 3.5.1rc1
- Push Spark appId to XCOM for LivyOperator with deferrable mode (#31201): @pankajkoti
- Optimize deferrable mode execution for
LivyOperator(#31685): @phanikumv
Provider apache.spark: 4.1.1rc1
Provider atlassian.jira: 2.1.1rc1
Provider cncf.kubernetes: 7.1.0rc1
- KubernetesResourceOperator - KubernetesDeleteResourceOperator & KubernetesCreateResourceOperator (#29930): @raphaelauv
- Add a return statement to enforce a single yield in certain triggers (#31985): @hussein-awala
- Add possibility to disable logging the pod template in a case when task fails (#31595): @svdimchenko
- Remove return statement after yield from triggers class (#31703): @pankajastro
- Fix Fargate logging for AWS system tests (#31622): @vincbeck
Provider databricks: 4.3.0rc1
- Add a return statement to enforce a single yield in certain triggers (#31985): @hussein-awala
-
DatabricksSubmitRunOperator: Fix type annotation forlibrariesparam (#31888): @phanikumv - Fix Databricks SQL operator serialization (#31780): @potiuk
- Making Databricks run related multi-query string in one session again (#31899): @dimonchik-suvorov
- Remove return statement after yield from triggers class (#31703): @pankajastro
Provider discord: 3.3.0rc1
Provider google: 10.2.0rc1
- Add a return statement to enforce a single yield in certain triggers (#31985): @hussein-awala
- Add deferrable mode to PubsubPullSensor (#31284): @bkossakowska
- Add a new param to set parquet row group size in
BaseSQLToGCSOperator(#31831): @hussein-awala - Add
cacheControlfield to google cloud storage (#31338): @ying-w - Add
preserveAsciiControlCharacterstosrc_fmt_configsfor GCStoBQ (#31643): @nathadfield - Add credential configuration file support to Google Secrets Manager secrets backend (#31597): @pgagnon
- Add credential configuration file support to Google Cloud Hook (#31548): @pgagnon
- Add deferrable mode to
GCSUploadSessionCompleteSensor(#31081): @phanikumv - Add append_job_name parameter in DataflowStartFlexTemplateOperator (#31511): @VladaZakharova
- Introduce configuration to disable md5 used for security (#31171): @longslvr
- MetastoreHivePartitionSensor (#31016): @moiseenkov
- Bigquery: fix links for already existing tables and datasets. (#31589): @bkossakowska
- Provide missing project id and creds for TabularDataset (#31991): @hussein-awala
- Optimize deferrable mode execution for
DataprocSubmitJobOperator(#31317): @phanikumv - Optimize deferrable mode execution for
BigQueryInsertJobOperator(#31249): @phanikumv - Remove return statement after yield from triggers class (#31703): @pankajastro
- Replace unicodecsv with standard csv library (#31693): @dstandish
- Optimize deferrable mode execution for
BigQueryCheckOperator(#31758): @phanikumv
Provider hashicorp: 3.4.1rc1
Provider jdbc: 4.0.0rc1
- Restrict direct usage of driver params via extras for JDBC connection (#31849): @pankajkoti
- Improve docstrings in providers (#31681): @uranusjr
- Add D400 pydocstyle check - Providers (#31427): @vincbeck
Provider microsoft.azure: 6.1.2rc1
- Replace unicodecsv with standard csv library (#31693): @dstandish
- Removed unused variables in AzureBlobStorageToGCSOperator (#31765): @Adaverse
- Add docstring and signature for _read_remote_logs (#31623): @dstandish
Provider microsoft.mssql: 3.4.1rc1
Provider mysql: 5.1.1rc1
Provider odbc: 4.0.0rc1
- Disable setting ODBC driver via extra by default (#31713): @potiuk
- Check if sqlalchemy_scheme extra contains forbidden characters (#31984): @potiuk
- Control permissibility of driver config in extra from airflow.cfg (#31754): @dstandish
- Improve docstrings in providers (#31681): @uranusjr
- Add D400 pydocstyle check - Providers (#31427): @vincbeck
Provider pagerduty: 3.3.0rc1
- Add notifier for pagerduty (#31207): @utkarsharma2
- Add send_event method in PagerdutyEventsHook (#31290): @utkarsharma2
Provider smtp: 1.2.0rc1
Provider snowflake: 4.2.0rc1
- Add SnowflakeSqlApiOperator operator (#30698): @utkarsharma2
- SnowflakeSqlApiOperator - Change the base class (#31751): @utkarsharma2
- Moved sql_api_generate_jwt out of hooks folder (#31586): @utkarsharma2
The guidelines on how to test providers can be found in
Verify providers by contributors
All users involved in the PRs:
@o-nikolas @utkarsharma2 @phanikumv @nathadfield @simonprydden @vargacypher @svdimchenko @longslvr @dstandish @uranusjr @dimonchik-suvorov @vincbeck @melugoyal @eladkal @Joffreybvn @sunank200
@moiseenkov @pankajastro @potiuk @killua1zoldyck @hussein-awala @raphaelauv @enchant3dmango @Lee-W @Adaverse @vandonr-amz @syedahsn @ying-w @bkossakowska @VladaZakharova @mahammi @pankajkoti @pgagnon
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.