Skip to content

Releases: ydb-platform/ydb-spark-connector

v1.3 - alpha release update

16 Nov 16:48
Compare
Choose a tag to compare

What's Changed

  • TRUNCATE implementation
  • Support for table creation on external metadata
  • Preparing for columnar tables support
  • Basic integration tests
  • Switched to YDB SDK version 2.3.6

Full Changelog: v1.2...v1.3

v1.2 - alpha release update

28 Jul 18:07
Compare
Choose a tag to compare

Minor updates: dependency versions bumped, enhanced shading settings.

Full Changelog: v1.1...v1.2

v1.1 - alpha release update

03 Jun 08:35
Compare
Choose a tag to compare

This is the first alpha release of YDB Connector for Apache Spark. It allows Spark applications to connect to YDB, and read and write row tables. All previously stated limitations still apply.

Changes:

  • fixed the GRPC dependency to match the YDB SDK version used. This is necessary to avoid the java.lang.IllegalAccessError exceptions on YDB discovery calls.

v1.0 - initial alpha release

06 Mar 10:38
Compare
Choose a tag to compare

This is the first alpha release of YDB Connector for Apache Spark. It allows Spark applications to connect to YDB, and read and write row tables. Known limitations:

  • Only row tables access has been tested. Reading and writing columnar tables is expected to fail.
  • The connector cannot read YDB system tables (e.g. those under the .sys directory).
  • Query results may be inconsistent in case of concurrent writes to the tables being read by the Connector.
  • In case of any error during the write operation performed through the Connector, the target table may be left inconsistent (some rows may have been written, and some have not).

These limitations are to be addressed in the future releases of the Connector.