diff --git a/docs/changelog/0.10.1.rst b/docs/changelog/0.10.1.rst new file mode 100644 index 000000000..7f30ca284 --- /dev/null +++ b/docs/changelog/0.10.1.rst @@ -0,0 +1,28 @@ +0.10.1 (2024-02-05) +=================== + +Features +-------- + +- Add support of ``Incremental Strategies`` for ``Kafka`` connection: + + .. code-block:: python + + reader = DBReader( + connection=Kafka(...), + source="topic_name", + hwm=AutoDetectHWM(name="some_hwm_name", expression="offset"), + ) + + with IncrementalStrategy(): + df = reader.run() + + This lets you resume reading data from a Kafka topic starting at the last committed offset from your previous run. (:github:pull:`202`) +- Add ``has_data``, ``raise_if_no_data`` methods to ``DBReader`` class. (:github:pull:`203`) +- Updare VMware Greenplum connector from ``2.1.4`` to ``2.3.0``. This implies: + * Greenplum 7.x support + * `Kubernetes support `_ + * New read option `gpdb.matchDistributionPolicy `_ + which allows to match each Spark executor with specific Greenplum segment, avoiding redundant data transfer between Greenplum segments + * Allows overriding `Greenplum optimizer parameters `_ in read/write operations (:github:pull:`208`) +- ``Greenplum.get_packages()`` method now accepts optional arg ``package_version`` which allows to override version of Greenplum connector package. (:github:pull:`208`) diff --git a/docs/changelog/index.rst b/docs/changelog/index.rst index 29163e700..557ac69b4 100644 --- a/docs/changelog/index.rst +++ b/docs/changelog/index.rst @@ -4,6 +4,7 @@ DRAFT NEXT_RELEASE + 0.10.1 0.10.0 0.9.5 0.9.4 diff --git a/docs/changelog/next_release/202.feature.rst b/docs/changelog/next_release/202.feature.rst deleted file mode 100644 index e8884958a..000000000 --- a/docs/changelog/next_release/202.feature.rst +++ /dev/null @@ -1,14 +0,0 @@ -Add support of ``Incremental Strategies`` for ``Kafka`` connection: - -.. code-block:: python - - reader = DBReader( - connection=Kafka(...), - source="topic_name", - hwm=AutoDetectHWM(name="some_hwm_name", expression="offset"), - ) - - with IncrementalStrategy(): - df = reader.run() - -This lets you resume reading data from a Kafka topic starting at the last committed offset from your previous run. diff --git a/docs/changelog/next_release/203.feature.rst b/docs/changelog/next_release/203.feature.rst deleted file mode 100644 index 304a02e33..000000000 --- a/docs/changelog/next_release/203.feature.rst +++ /dev/null @@ -1 +0,0 @@ -Add ``has_data``, ``raise_if_no_data`` methods to ``DBReader`` class. diff --git a/docs/changelog/next_release/208.feature.1.rst b/docs/changelog/next_release/208.feature.1.rst deleted file mode 100644 index 84dbd1a65..000000000 --- a/docs/changelog/next_release/208.feature.1.rst +++ /dev/null @@ -1,6 +0,0 @@ -Updare VMware Greenplum connector from ``2.1.4`` to ``2.3.0``. This implies: - * Greenplum 7.x support - * `Kubernetes support `_ - * New read option `gpdb.matchDistributionPolicy `_ - which allows to match each Spark executor with specific Greenplum segment, avoiding redundant data transfer between Greenplum segments - * Allows overriding `Greenplum optimizer parameters `_ in read/write operations diff --git a/docs/changelog/next_release/208.feature.2.rst b/docs/changelog/next_release/208.feature.2.rst deleted file mode 100644 index 1f7bdd665..000000000 --- a/docs/changelog/next_release/208.feature.2.rst +++ /dev/null @@ -1 +0,0 @@ -``Greenplum.get_packages()`` method now accepts optional arg ``package_version`` which allows to override version of Greenplum connector package.