Skip to content

Commit

Permalink
Prepare docs 2nd wave May 2024 (#39565)
Browse files Browse the repository at this point in the history
* Prepare docs 2nd wave May 2024

* add more changes to google
  • Loading branch information
eladkal committed May 12, 2024
1 parent ffa523f commit 97e867f
Show file tree
Hide file tree
Showing 19 changed files with 171 additions and 28 deletions.
25 changes: 25 additions & 0 deletions airflow/providers/amazon/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,31 @@
Changelog
---------

8.22.0
......

Features
~~~~~~~~

* ``'S3DeleteObjectsOperator' Added ability to filter keys by last modified time (#39151)``
* ``Amazon Bedrock - Add Knowledge Bases and Data Sources integration (#39245)``

Bug Fixes
~~~~~~~~~

* ``EcsExcecutor Scheduler to handle incrementing of try_number (#39336)``
* ``ECS Executor: Set tasks to RUNNING state once active (#39212)``

Misc
~~~~

* ``Add 'jmespath' as an explicit dependency (#39350)``
* ``Drop 'xmlsec' dependency (#39534)``
* ``Reapply templates for all providers (#39554)``
* ``Faster 'airflow_version' imports (#39552)``
* ``enh(amazon_hook): raise not found exception instead of general exception when download file (#39509)``
* ``Simplify 'airflow_version' imports (#39497)``

8.21.0
......

Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/amazon/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@

__all__ = ["__version__"]

__version__ = "8.21.0"
__version__ = "8.22.0"

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.7.0"
Expand Down
3 changes: 2 additions & 1 deletion airflow/providers/amazon/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -22,9 +22,10 @@ description: |
Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).
state: ready
source-date-epoch: 1715384391
source-date-epoch: 1715450472
# note that those versions are maintained by release manager - do not update them manually
versions:
- 8.22.0
- 8.21.0
- 8.20.0
- 8.19.0
Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/apache/iceberg/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -29,4 +29,4 @@ Changelog
1.0.0
.....

Initial version of the provider.
* ``Add Apache Iceberg provider (#39155)``
28 changes: 22 additions & 6 deletions airflow/providers/google/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,8 @@ Features
* ``Enhancement for SSL-support in CloudSQLExecuteQueryOperator (#38894)``
* ``Create GKESuspendJobOperator and GKEResumeJobOperator operators (#38677)``
* ``Add support for role arn for aws creds in Google Transfer Service operator (#38911)``
* ``Add encryption_configuration parameter to BigQueryCheckOperator and BigQueryTableCheckOperator (#39432)``
* ``Add 'job_id' parameter to 'BigQueryGetDataOperator' (#39315)``

Bug Fixes
~~~~~~~~~
Expand All @@ -54,12 +56,19 @@ Bug Fixes
* ``Fix batching for BigQueryToPostgresOperator (#39233)``
* ``Fix DataprocSubmitJobOperator in deferrable mode=True when task is marked as failed. (#39230)``
* ``Fix GCSObjectExistenceSensor operator to return the same XCOM value in deferrable and non-deferrable mode (#39206)``
* ``Bugfix conn_id BigQueryToMsSqlOperator (#39171)``
* ``fix: add retry logic in case of google auth refresh credential error (#38961)``
* ``fix: BigQueryCheckOperator skipped value and error check in deferrable mode (#38408)``
* ``fix: Use prefixes instead of all file paths for OpenLineage datasets in GCSDeleteObjectsOperator (#39059)``
* ``fix: Use prefixes instead of full file paths for OpenLineage datasets in GCSToGCSOperator (#39058)``
* ``fix: OpenLineage datasets in GCSTimeSpanFileTransformOperator (#39064)``
* ``Fix conn_id BigQueryToMsSqlOperator (#39171)``
* ``Fix add retry logic in case of google auth refresh credential error (#38961)``
* ``Fix BigQueryCheckOperator skipped value and error check in deferrable mode (#38408)``
* ``Fix Use prefixes instead of all file paths for OpenLineage datasets in GCSDeleteObjectsOperator (#39059)``
* ``Fix Use prefixes instead of full file paths for OpenLineage datasets in GCSToGCSOperator (#39058)``
* ``Fix OpenLineage datasets in GCSTimeSpanFileTransformOperator (#39064)``
* ``Fix generation temp filename in 'DataprocSubmitPySparkJobOperator' (#39498)``
* ``Fix logic to cancel the external job if the TaskInstance is not in a running or deferred state for DataprocSubmitJobOperator (#39447)``
* ``Fix logic to cancel the external job if the TaskInstance is not in a running or deferred state for BigQueryInsertJobOperator (#39442)``
* ``Fix logic to cancel the external job if the TaskInstance is not in a running or deferred state for DataprocCreateClusterOperator (#39446)``
* ``Fix 'DataprocCreateBatchOperator' with 'result_retry' raises 'AttributeError' (#39462)``
* ``Fix yaml parsing for GKEStartKueueInsideClusterOperator (#39234)``
* ``Fix validation of label values in BigQueryInsertJobOperator (#39568)``

Misc
~~~~
Expand All @@ -69,10 +78,17 @@ Misc
* ``Adding MSGraphOperator in Microsoft Azure provider (#38111)``
* ``Apply PROVIDE_PROJECT_ID mypy workaround across Google provider (#39129)``
* ``handle KubernetesDeleteJobOperator import (#39036)``
* ``Remove Airflow 2.6 back compact code (#39558)``
* ``Reapply templates for all providers (#39554)``
* ``Faster 'airflow_version' imports (#39552)``
* ``Add deprecation warnings and raise exception for already deprecated ones (#38673)``
* ``Simplify 'airflow_version' imports (#39497)``
* ``Disconnect GKE operators from deprecated hooks (#39434)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Activate RUF019 that checks for unnecessary key check (#38950)``
* ``Prepare docs 1st wave May 2024 (#39328)``
10.17.0
.......
Expand Down
7 changes: 7 additions & 0 deletions airflow/providers/microsoft/azure/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ Features
* ``Adding MSGraphOperator in Microsoft Azure provider (#38111)``
* ``Make handling of connection by fs/adls.py closer to that of WasbHook and add unit tests. (#38747)``
* ``Implement run-method on KiotaRequestAdapterHook and move logic away from triggerer to hook (#39237)``
* ``Implemented MSGraphSensor as a deferrable sensor (#39304)``

Bug Fixes
~~~~~~~~~
Expand All @@ -52,6 +53,12 @@ Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)``
* ``Reapply templates for all providers (#39554)``
* ``Faster 'airflow_version' imports (#39552)``
* ``Simplify 'airflow_version' imports (#39497)``

.. Review and move the new changes to one of the sections above:
* ``Prepare docs 1st wave May 2024 (#39328)``
10.0.0
......
Expand Down
5 changes: 5 additions & 0 deletions airflow/providers/pinecone/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -60,13 +60,18 @@ Misc
~~~~

* ``Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)``
* ``Faster 'airflow_version' imports (#39552)``
* ``Simplify 'airflow_version' imports (#39497)``
* ``CreatePodIndexOperator fix defaults of pod_type and metric parameters (#39365)``
* ``Reapply templates for all providers (#39554)``

.. Review and move the new changes to one of the sections above:
* ``Prepare docs 1st wave (RC1) April 2024 (#38863)``
* ``Bump ruff to 0.3.3 (#38240)``
* ``Prepare docs 1st wave (RC1) March 2024 (#37876)``
* ``Add comment about versions updated by release manager (#37488)``
* ``D401 fixes in Pinecone provider (#37270)``
* ``Prepare docs 1st wave May 2024 (#39328)``
1.1.2
.....
Expand Down
13 changes: 13 additions & 0 deletions airflow/providers/tabular/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,19 @@
Changelog
---------

1.5.1
.....

.. note::
Classes in this provider have been deprecated in favor of Apache Iceberg provider.

Misc
~~~~

* ``Deprecate Tabular provider classes in favor of Apache Iceberg provider (#39155)``
* ``Reapply templates for all providers (#39554)``
* ``Simplify 'airflow_version' imports (#39497)``

1.5.0
.....

Expand Down
2 changes: 1 addition & 1 deletion airflow/providers/tabular/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@

__all__ = ["__version__"]

__version__ = "1.5.0"
__version__ = "1.5.1"

if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
"2.7.0"
Expand Down
3 changes: 2 additions & 1 deletion airflow/providers/tabular/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -22,9 +22,10 @@ description: |
`Tabular <https://tabular.io/>`__
state: ready
source-date-epoch: 1715404374
source-date-epoch: 1715450969
# note that those versions are maintained by release manager - do not update them manually
versions:
- 1.5.1
- 1.5.0
- 1.4.1
- 1.4.0
Expand Down
23 changes: 22 additions & 1 deletion docs/apache-airflow-providers-amazon/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -35,14 +35,35 @@ For high-level changelog, see :doc:`package information including changelog <ind



8.22.0
......

Latest change: 2024-05-11

================================================================================================= =========== ========================================================================================================
Commit Committed Subject
================================================================================================= =========== ========================================================================================================
`ca058a635e <https://github.com/apache/airflow/commit/ca058a635ee53b3717964b8bf4bfce241f40e762>`_ 2024-05-11 ``enh(amazon_hook): raise not found exception instead of general exception when download file (#39509)``
`2b1a2f8d56 <https://github.com/apache/airflow/commit/2b1a2f8d561e569df194c4ee0d3a18930738886e>`_ 2024-05-11 ``Reapply templates for all providers (#39554)``
`2c05187b07 <https://github.com/apache/airflow/commit/2c05187b07baf7c41a32b18fabdbb3833acc08eb>`_ 2024-05-10 ``Faster 'airflow_version' imports (#39552)``
`c9f4618be4 <https://github.com/apache/airflow/commit/c9f4618be4a88d8287cf579230380dda8edaeafd>`_ 2024-05-09 ``Drop 'xmlsec' pin (#39534)``
`3938f71dfa <https://github.com/apache/airflow/commit/3938f71dfae21c84a3518625543a28ad02edf641>`_ 2024-05-08 ``Scheduler to handle incrementing of try_number (#39336)``
`73918925ed <https://github.com/apache/airflow/commit/73918925edaf1c94790a6ad8bec01dec60accfa1>`_ 2024-05-08 ``Simplify 'airflow_version' imports (#39497)``
`9c739d7142 <https://github.com/apache/airflow/commit/9c739d714278645a3c8cab25d02db843fef06d9d>`_ 2024-05-07 ``'S3DeleteObjectsOperator' Added ability to filter keys by last modified time (#39151)``
`a74b5f0694 <https://github.com/apache/airflow/commit/a74b5f069481e1a2339cfd95e137619b16390906>`_ 2024-05-06 ``ECS Executor: Set tasks to RUNNING state once active (#39212)``
`598398a816 <https://github.com/apache/airflow/commit/598398a81657c06e092d1290200a9facf82f55f3>`_ 2024-05-02 ``Amazon Bedrock - Knowledge Bases and Data Sources (#39245)``
`4910c0439b <https://github.com/apache/airflow/commit/4910c0439bf370348a63f445bbeb8051a93e22fd>`_ 2024-05-01 ``Add 'jmespath' as an explicit dependency (#39350)``
================================================================================================= =========== ========================================================================================================

8.21.0
......

Latest change: 2024-04-30
Latest change: 2024-05-01

================================================================================================= =========== ============================================================================================================
Commit Committed Subject
================================================================================================= =========== ============================================================================================================
`fe4605a10e <https://github.com/apache/airflow/commit/fe4605a10e26f1b8a180979ba5765d1cb7fb0111>`_ 2024-05-01 ``Prepare docs 1st wave May 2024 (#39328)``
`91490fb054 <https://github.com/apache/airflow/commit/91490fb054e1b86846ab6ab33fe79384d2de3751>`_ 2024-04-30 ``Added logging_config,snapstart,ephemeral_storage parameters to aws lambdacreatefunctionoperator (#39300)``
`4fa9fe119e <https://github.com/apache/airflow/commit/4fa9fe119e5aae639c942668f40a15a6ef0f7f67>`_ 2024-04-29 ``Rename "try_number" increments that are unrelated to the airflow concept (#39317)``
`6d09adf992 <https://github.com/apache/airflow/commit/6d09adf99262144c71bd15c09bc18f956667ccae>`_ 2024-04-26 ``Add tests for 'EmrServerlessJobSensor' and 'EmrServerlessApplicationSensor' (#39099)``
Expand Down
6 changes: 3 additions & 3 deletions docs/apache-airflow-providers-amazon/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@ apache-airflow-providers-amazon package
Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).


Release: 8.21.0
Release: 8.22.0

Provider package
----------------
Expand Down Expand Up @@ -161,5 +161,5 @@ Downloading official packages
You can download officially released packages and verify their checksums and signatures from the
`Official Apache Download site <https://downloads.apache.org/airflow/providers/>`_

* `The apache-airflow-providers-amazon 8.21.0 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.21.0.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.21.0.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.21.0.tar.gz.sha512>`__)
* `The apache-airflow-providers-amazon 8.21.0 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.21.0-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.21.0-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.21.0-py3-none-any.whl.sha512>`__)
* `The apache-airflow-providers-amazon 8.22.0 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.22.0.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.22.0.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.22.0.tar.gz.sha512>`__)
* `The apache-airflow-providers-amazon 8.22.0 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.22.0-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.22.0-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-8.22.0-py3-none-any.whl.sha512>`__)
19 changes: 16 additions & 3 deletions docs/apache-airflow-providers-apache-iceberg/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -26,10 +26,23 @@
Package apache-airflow-providers-apache-iceberg
------------------------------------------------------
`Iceberg <https://iceberg.apache.org/>`__

`Tabular <https://tabular.io/>`__
`Iceberg <https://iceberg.apache.org/>`__


This is detailed commit list of changes for versions provider package: ``iceberg``.
This is detailed commit list of changes for versions provider package: ``apache.iceberg``.
For high-level changelog, see :doc:`package information including changelog <index>`.



1.0.0
.....

Latest change: 2024-05-11

================================================================================================= =========== ================================================
Commit Committed Subject
================================================================================================= =========== ================================================
`2b1a2f8d56 <https://github.com/apache/airflow/commit/2b1a2f8d561e569df194c4ee0d3a18930738886e>`_ 2024-05-11 ``Reapply templates for all providers (#39554)``
`da79f6b206 <https://github.com/apache/airflow/commit/da79f6b206a3b8a411e951ede60986e40433ebb8>`_ 2024-05-10 ``Add Iceberg provider (#39155)``
================================================================================================= =========== ================================================
Loading

0 comments on commit 97e867f

Please sign in to comment.