Releases: ydb-platform/ydb-spark-connector
Releases · ydb-platform/ydb-spark-connector
v1.3 - alpha release update
What's Changed
- TRUNCATE implementation
- Support for table creation on external metadata
- Preparing for columnar tables support
- Basic integration tests
- Switched to YDB SDK version 2.3.6
Full Changelog: v1.2...v1.3
v1.2 - alpha release update
Minor updates: dependency versions bumped, enhanced shading settings.
Full Changelog: v1.1...v1.2
v1.1 - alpha release update
This is the first alpha release of YDB Connector for Apache Spark. It allows Spark applications to connect to YDB, and read and write row tables. All previously stated limitations still apply.
Changes:
- fixed the GRPC dependency to match the YDB SDK version used. This is necessary to avoid the
java.lang.IllegalAccessError
exceptions on YDB discovery calls.
v1.0 - initial alpha release
This is the first alpha release of YDB Connector for Apache Spark. It allows Spark applications to connect to YDB, and read and write row tables. Known limitations:
- Only row tables access has been tested. Reading and writing columnar tables is expected to fail.
- The connector cannot read YDB system tables (e.g. those under the
.sys
directory). - Query results may be inconsistent in case of concurrent writes to the tables being read by the Connector.
- In case of any error during the write operation performed through the Connector, the target table may be left inconsistent (some rows may have been written, and some have not).
These limitations are to be addressed in the future releases of the Connector.