Releases: GoogleCloudDataproc/hadoop-connectors
2.2.11
- Added dependency on new storage client library: google-cloud-storage.
- Add support for OAuth2 based client authentication that retrieves
a refresh token using the authorisation code grant flow configured via the
following properties:fs.gs.auth.client.id fs.gs.auth.client.secret fs.gs.auth.refresh.token
2.2.10
- Update dependencies to latest version
2.1.9
- Set socket read timeout (
fs.gs.http.read-timeout
) as early as possible on
new sockets returned from the customSSLSocketFactory
. This guarantees the
timeout is enforced during TLS handshakes when using Conscrypt as the
security provider. - The Google Cloud Storage Connector now can be used as a
Hadoop Credential Provider.
2.2.9
- The Google Cloud Storage Connector now can be used as a
Hadoop Credential Provider.
2022-09-15 (GCS 2.2.8)
What's Changed
2.2.8 - 2022-09-12
-
Set socket read timeout (
fs.gs.http.read-timeout
) as early as possible on
new sockets returned from the customSSLSocketFactory
. This guarantees the
timeout is enforced during TLS handshakes when using Conscrypt as the
security provider. -
Add trace logging for JSON and gRPC requests, toggled with option:
fs.gs.tracelog.enable (default : false)
-
Fixing seek back to same position with grpc channel.
-
Grpc read optimization to not prematurely close existing requests.
-
Retry request on 408/timeout response from server.
-
Upgrade Google auth dependency to 1.7.0.
-
Increasing gRPC read timeout from 30 seconds to 3600 seconds.
-
Set default value for
fs.gs.list.max.items.per.call
property to5000
. -
Adding support for invocationId in Json path.
Full Changelog: v2.2.7...v2.2.8
2022-06-01 (GCS 2.2.7)
What's Changed
-
Fix: Prevent clobbering of SSL trustCertificates
-
Lazy footer prefetch optimizations
-
Make writes via GCS gRPC API resilient
Full Changelog: v2.2.6...v2.2.7
2022-05-31 (GCS 2.1.8)
Changelog
- Prevent clobbering of SSL trustCertificates
2022-04-14 (GCS 2.2.6)
-
Improve trace logging for gRPC channels.
-
Traffic Director is enabled by default.
2022-02-09 (GCS 2.2.5)
-
[grpc] Refactor footer caching logic
-
Enable TCP keep alive by default.
-
Upgrade gRPC to 1.43
-
Add message level timeouts for gRPC requests
-
Added Traffic Director support
2022-02-07 (GCS 2.1.7)
Changlelog
Cloud Storage connector:
- Enable TCP keep alive socket option by default.