Skip to content

Releases: GoogleCloudDataproc/hadoop-connectors

2.2.11

24 Jan 05:58
e254c59
Compare
Choose a tag to compare
  1. Added dependency on new storage client library: google-cloud-storage.
  2. Add support for OAuth2 based client authentication that retrieves
    a refresh token using the authorisation code grant flow configured via the
    following properties:
    fs.gs.auth.client.id
    fs.gs.auth.client.secret
    fs.gs.auth.refresh.token
    

2.2.10

12 Dec 06:52
39cc7ba
Compare
Choose a tag to compare
  1. Update dependencies to latest version

2.1.9

16 Nov 02:04
Compare
Choose a tag to compare
  1. Set socket read timeout (fs.gs.http.read-timeout) as early as possible on
    new sockets returned from the custom SSLSocketFactory. This guarantees the
    timeout is enforced during TLS handshakes when using Conscrypt as the
    security provider.
  2. The Google Cloud Storage Connector now can be used as a
    Hadoop Credential Provider.

2.2.9

09 Nov 13:30
18f6e9f
Compare
Choose a tag to compare
  1. The Google Cloud Storage Connector now can be used as a
    Hadoop Credential Provider.

2022-09-15 (GCS 2.2.8)

15 Sep 23:44
e51b0f8
Compare
Choose a tag to compare

What's Changed

2.2.8 - 2022-09-12

  1. Set socket read timeout (fs.gs.http.read-timeout) as early as possible on
    new sockets returned from the custom SSLSocketFactory. This guarantees the
    timeout is enforced during TLS handshakes when using Conscrypt as the
    security provider.

  2. Add trace logging for JSON and gRPC requests, toggled with option:

    fs.gs.tracelog.enable (default : false)
    
  3. Fixing seek back to same position with grpc channel.

  4. Grpc read optimization to not prematurely close existing requests.

  5. Retry request on 408/timeout response from server.

  6. Upgrade Google auth dependency to 1.7.0.

  7. Increasing gRPC read timeout from 30 seconds to 3600 seconds.

  8. Set default value for fs.gs.list.max.items.per.call property to 5000.

  9. Adding support for invocationId in Json path.

Full Changelog: v2.2.7...v2.2.8

2022-06-01 (GCS 2.2.7)

06 Jun 09:57
8453ce7
Compare
Choose a tag to compare

What's Changed

  1. Fix: Prevent clobbering of SSL trustCertificates

  2. Lazy footer prefetch optimizations

  3. Make writes via GCS gRPC API resilient

Full Changelog: v2.2.6...v2.2.7

2022-05-31 (GCS 2.1.8)

31 May 06:31
d55fdd2
Compare
Choose a tag to compare

Changelog

  1. Prevent clobbering of SSL trustCertificates

2022-04-14 (GCS 2.2.6)

15 Apr 23:05
619c8bd
Compare
Choose a tag to compare
  1. Improve trace logging for gRPC channels.

  2. Traffic Director is enabled by default.

2022-02-09 (GCS 2.2.5)

09 Feb 07:14
Compare
Choose a tag to compare
  1. [grpc] Refactor footer caching logic

  2. Enable TCP keep alive by default.

  3. Upgrade gRPC to 1.43

  4. Add message level timeouts for gRPC requests

  5. Added Traffic Director support

2022-02-07 (GCS 2.1.7)

07 Feb 16:21
6c38292
Compare
Choose a tag to compare

Changlelog

Cloud Storage connector:

  1. Enable TCP keep alive socket option by default.