Skip to content

2018-04-12 (GCS 1.6.5, BQ 0.10.6)
Compare
Choose a tag to compare
@medb medb released this 13 Apr 00:07
· 67 commits to branch-1.6.x since this release
v1.6.5
f8d8c40

Changelog

Cloud Storage connector:

  1. Add support for using Cloud Storage Rewrite requests for copy operation:

    fs.gs.copy.with.rewrite.enable (default: false)

    This allows to copy files between different locations and storage classes.

  2. Update all dependencies to latest versions.

  3. Decrease default value for max requests per batch from 1,000 to 30.

  4. Make max requests per batch value configurable with property:

    fs.gs.max.requests.per.batch (default: 30)

BigQuery connector:

  1. Wire location through load, extract, and query jobs.
  2. Always require at least 2 partitions for sharded exports.
  3. Update all dependencies to latest versions.
  4. POM updates for GCS connector 1.6.5.
Assets 2
Loading