cloud-dataplex

Cloud Dataplex instance with lake, zone & assests

This module manages the creation of Cloud Dataplex instance along with lake, zone & assets in single regions.

Simple example

This example shows how to setup a Cloud Dataplex instance, lake, zone & asset creation in GCP project.

module "dataplex" {
  source     = "./fabric/modules/cloud-dataplex"
  name       = "terraform-lake"
  prefix     = "test"
  project_id = "myproject"
  region     = "europe-west2"
  zones = {
    zone_1 = {
      type      = "RAW"
      discovery = true
      assets = {
        asset_1 = {
          bucket_name            = "asset_1"
          cron_schedule          = "15 15 * * *"
          discovery_spec_enabled = true
          resource_spec_type     = "STORAGE_BUCKET"
        }
      }
    },
    zone_2 = {
      type      = "CURATED"
      discovery = true
      assets = {
        asset_2 = {
          bucket_name            = "asset_2"
          cron_schedule          = "15 15 * * *"
          discovery_spec_enabled = true
          resource_spec_type     = "STORAGE_BUCKET"
        }
      }
    }
  }
}

# tftest modules=1 resources=5

TODO

• Add IAM support
• support different type of assets
• support multi-regions

Variables

name	description	type	required	default
name	Name of Dataplex Lake.	string	✓
prefix	Optional prefix used to generate Dataplex Lake.	string	✓
project_id	The ID of the project where this Dataplex Lake will be created.	string	✓
region	Region of the Dataplax Lake.	string	✓
zones	Dataplex lake zones, such as RAW and CURATED.	map(object({…}))	✓
location_type	The location type of the Dataplax Lake.	string		"SINGLE_REGION"

Outputs

name	description	sensitive
assets	Assets attached to the lake of Dataplex Lake.
id	Fully qualified Dataplex Lake id.
lake	The lake name of Dataplex Lake.
zones	The zone name of Dataplex Lake.