Skip to content

CDAP 6.9.2
Compare
Choose a tag to compare
@dli357 dli357 released this 02 Sep 07:06
· 107 commits to release/6.9 since this release
v6.9.2
3cf83ab
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Improvements

CDAP-19428: CDAP supports setting custom scopes when creating a Dataproc cluster.

CDAP-20698: You can set common metadata labels for Dataproc clusters and jobs using the Common Labels property in the Ephemeral Dataproc compute profile.

You can set labels for the Dataproc jobs using the Common Labels property in the Existing Dataproc compute profile.

You can set a pipeline runtime argument with the key system.profile.properties.labels and a value representing the labels in the following format: key1|value1;key2|value2. This setting overrides the common labels set in the compute profile for pipeline runs.

CDAP-20712: CDAP supports using Dataproc temp buckets in compute profiles.

Fixes

PLUGIN-1660: Added retry for Pub/Sub snapshot creation and deletion in real-time pipeline with a Pub/Sub source when a retryable internal error is thrown.

CDAP-20674: Fixed a bug causing the Dynamic Spark plugins to fail when running on Dataproc 1.5.

CDAP-20680: Fixed a discrepancy in warning and error counts reported between the pipeline summary tab and system logs.

CDAP-20759: Fixed a problem when, in rare cases, a cluster couldn't be found with Cluster Reuse.

CDAP-20778: Fixed a bug causing the JavaScript transform to fail on Dataproc 2.1.

Assets 2
Loading