From 631cb1d2218219b0c636a106c6da5633f5123f57 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?=D0=9C=D0=B0=D1=80=D1=82=D1=8B=D0=BD=D0=BE=D0=B2=20=D0=9C?= =?UTF-8?q?=D0=B0=D0=BA=D1=81=D0=B8=D0=BC=20=D0=A1=D0=B5=D1=80=D0=B3=D0=B5?= =?UTF-8?q?=D0=B5=D0=B2=D0=B8=D1=87?= Date: Mon, 5 Feb 2024 09:04:31 +0000 Subject: [PATCH] [DOP-11905] Prepare for release --- docs/changelog/0.10.1.rst | 28 +++++++++++++++++++ docs/changelog/index.rst | 1 + docs/changelog/next_release/202.feature.rst | 14 ---------- docs/changelog/next_release/203.feature.rst | 1 - docs/changelog/next_release/208.feature.1.rst | 6 ---- docs/changelog/next_release/208.feature.2.rst | 1 - 6 files changed, 29 insertions(+), 22 deletions(-) create mode 100644 docs/changelog/0.10.1.rst delete mode 100644 docs/changelog/next_release/202.feature.rst delete mode 100644 docs/changelog/next_release/203.feature.rst delete mode 100644 docs/changelog/next_release/208.feature.1.rst delete mode 100644 docs/changelog/next_release/208.feature.2.rst diff --git a/docs/changelog/0.10.1.rst b/docs/changelog/0.10.1.rst new file mode 100644 index 000000000..7f30ca284 --- /dev/null +++ b/docs/changelog/0.10.1.rst @@ -0,0 +1,28 @@ +0.10.1 (2024-02-05) +=================== + +Features +-------- + +- Add support of ``Incremental Strategies`` for ``Kafka`` connection: + + .. code-block:: python + + reader = DBReader( + connection=Kafka(...), + source="topic_name", + hwm=AutoDetectHWM(name="some_hwm_name", expression="offset"), + ) + + with IncrementalStrategy(): + df = reader.run() + + This lets you resume reading data from a Kafka topic starting at the last committed offset from your previous run. (:github:pull:`202`) +- Add ``has_data``, ``raise_if_no_data`` methods to ``DBReader`` class. (:github:pull:`203`) +- Updare VMware Greenplum connector from ``2.1.4`` to ``2.3.0``. This implies: + * Greenplum 7.x support + * `Kubernetes support `_ + * New read option `gpdb.matchDistributionPolicy `_ + which allows to match each Spark executor with specific Greenplum segment, avoiding redundant data transfer between Greenplum segments + * Allows overriding `Greenplum optimizer parameters `_ in read/write operations (:github:pull:`208`) +- ``Greenplum.get_packages()`` method now accepts optional arg ``package_version`` which allows to override version of Greenplum connector package. (:github:pull:`208`) diff --git a/docs/changelog/index.rst b/docs/changelog/index.rst index 29163e700..557ac69b4 100644 --- a/docs/changelog/index.rst +++ b/docs/changelog/index.rst @@ -4,6 +4,7 @@ DRAFT NEXT_RELEASE + 0.10.1 0.10.0 0.9.5 0.9.4 diff --git a/docs/changelog/next_release/202.feature.rst b/docs/changelog/next_release/202.feature.rst deleted file mode 100644 index e8884958a..000000000 --- a/docs/changelog/next_release/202.feature.rst +++ /dev/null @@ -1,14 +0,0 @@ -Add support of ``Incremental Strategies`` for ``Kafka`` connection: - -.. code-block:: python - - reader = DBReader( - connection=Kafka(...), - source="topic_name", - hwm=AutoDetectHWM(name="some_hwm_name", expression="offset"), - ) - - with IncrementalStrategy(): - df = reader.run() - -This lets you resume reading data from a Kafka topic starting at the last committed offset from your previous run. diff --git a/docs/changelog/next_release/203.feature.rst b/docs/changelog/next_release/203.feature.rst deleted file mode 100644 index 304a02e33..000000000 --- a/docs/changelog/next_release/203.feature.rst +++ /dev/null @@ -1 +0,0 @@ -Add ``has_data``, ``raise_if_no_data`` methods to ``DBReader`` class. diff --git a/docs/changelog/next_release/208.feature.1.rst b/docs/changelog/next_release/208.feature.1.rst deleted file mode 100644 index 84dbd1a65..000000000 --- a/docs/changelog/next_release/208.feature.1.rst +++ /dev/null @@ -1,6 +0,0 @@ -Updare VMware Greenplum connector from ``2.1.4`` to ``2.3.0``. This implies: - * Greenplum 7.x support - * `Kubernetes support `_ - * New read option `gpdb.matchDistributionPolicy `_ - which allows to match each Spark executor with specific Greenplum segment, avoiding redundant data transfer between Greenplum segments - * Allows overriding `Greenplum optimizer parameters `_ in read/write operations diff --git a/docs/changelog/next_release/208.feature.2.rst b/docs/changelog/next_release/208.feature.2.rst deleted file mode 100644 index 1f7bdd665..000000000 --- a/docs/changelog/next_release/208.feature.2.rst +++ /dev/null @@ -1 +0,0 @@ -``Greenplum.get_packages()`` method now accepts optional arg ``package_version`` which allows to override version of Greenplum connector package.