control center cdap

cloudsufi · Nov 16, 2023 · 5b7da21 · 5b7da21
1 parent d45ca13
commit 5b7da21
Show file tree

Hide file tree

Showing 2 changed files with 257 additions and 2 deletions.
diff --git a/cdap-e2e-tests/src/e2e-test/features/controlcenter/ControlCenter.feature b/cdap-e2e-tests/src/e2e-test/features/controlcenter/ControlCenter.feature
@@ -140,7 +140,260 @@ Feature: Controlcenter - Validate control center page flow
        Then Verify the user is able to enter the value of the key in the value input field "value"
        Then Verify user is able to click on save and close button of set preferences
        Then Verify user is able to click on the data pipeline added in the control center page
-       Then Enter runtime argument value "projectId" for key "projectId"
-       Then Run the Pipeline in Runtime with runtime arguments
+       Then Run the Pipeline in Runtime
        Then Wait till pipeline is in running state
        Then Verify the pipeline status is "Succeeded"
+
+       @BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
+       Scenario: Verify User is able to delete the preferences by clicking on the delete icon button
+         Given Open Datafusion Project to configure pipeline
+         Then Click on the Hamburger bar on the left panel
+         Then Click on Control Center link from the hamburger menu
+         Then Click on the Plus Green Button to import the pipelines
+         Then Verify user is able to click on the create button to create a pipeline successfully
+         When Expand Plugin group in the LHS plugins list: "Source"
+         When Select plugin: "BigQuery" from the plugins list as: "Source"
+         When Expand Plugin group in the LHS plugins list: "Sink"
+         When Select plugin: "BigQuery" from the plugins list as: "Sink"
+         Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
+         Then Navigate to the properties page of plugin: "BigQuery"
+         And Enter input plugin property: "referenceName" with value: "Reference"
+         Then Click on the Macro button of Property: "project" and set the value to: "projectId"
+         And Enter input plugin property: "datasetProject" with value: "projectId"
+         And Replace input plugin property: "dataset" with value: "dataset"
+         Then Override Service account details if set in environment variables
+         And Enter input plugin property: "table" with value: "bqSourceTable"
+         Then Click on the Get Schema button
+         Then Validate "BigQuery" plugin properties
+         And Close the Plugin Properties page
+         Then Navigate to the properties page of plugin: "BigQuery2"
+         Then Click on the Macro button of Property: "project" and set the value to: "projectId"
+         Then Override Service account details if set in environment variables
+         Then Enter input plugin property: "datasetProject" with value: "projectId"
+         Then Enter input plugin property: "referenceName" with value: "BQReferenceName"
+         Then Enter input plugin property: "dataset" with value: "dataset"
+         Then Enter input plugin property: "table" with value: "bqTargetTable"
+         Then Validate "BigQuery" plugin properties
+         And Close the Plugin Properties page
+         Then Save the pipeline
+         Then Deploy the pipeline
+         Then Click on the Hamburger bar on the left panel
+         Then Click on Control Center link from the hamburger menu
+         Then Verify the user is able to set the preferences for the created pipeline in the control center page
+         Then Verify the user is able to enter the value in the key input field "keyValue"
+         Then Verify the user is able to enter the value of the key in the value input field "value"
+         Then Verify user is able to click on save and close button of set preferences
+         Then Verify user is able to click on the delete icon of preferences to delete the added preferences successfully
+
+         @BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
+         Scenario: Verify that User is able to click on the dataset entity and User is navigated to the details page of the dataset successfully
+           Given Open Datafusion Project to configure pipeline
+           Then Click on the Hamburger bar on the left panel
+           Then Click on Control Center link from the hamburger menu
+           Then Click on the Plus Green Button to import the pipelines
+           Then Verify user is able to click on the create button to create a pipeline successfully
+           When Expand Plugin group in the LHS plugins list: "Source"
+           When Select plugin: "BigQuery" from the plugins list as: "Source"
+           When Expand Plugin group in the LHS plugins list: "Sink"
+           When Select plugin: "BigQuery" from the plugins list as: "Sink"
+           Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
+           Then Navigate to the properties page of plugin: "BigQuery"
+           And Enter input plugin property: "referenceName" with value: "ReferenceDataset"
+           And Replace input plugin property: "project" with value: "projectId"
+           And Enter input plugin property: "datasetProject" with value: "projectId"
+           And Replace input plugin property: "dataset" with value: "dataset"
+           Then Override Service account details if set in environment variables
+           And Enter input plugin property: "table" with value: "bqSourceTable"
+           Then Click on the Get Schema button
+           Then Validate "BigQuery" plugin properties
+           And Close the Plugin Properties page
+           Then Navigate to the properties page of plugin: "BigQuery2"
+           Then Replace input plugin property: "project" with value: "projectId"
+           Then Override Service account details if set in environment variables
+           Then Enter input plugin property: "datasetProject" with value: "projectId"
+           Then Enter input plugin property: "referenceName" with value: "BQReferenceNameDataset"
+           Then Enter input plugin property: "dataset" with value: "dataset"
+           Then Enter input plugin property: "table" with value: "bqTargetTable"
+           Then Validate "BigQuery" plugin properties
+           And Close the Plugin Properties page
+           Then Save the pipeline
+           Then Deploy the pipeline
+           Then Run the Pipeline in Runtime
+           Then Wait till pipeline is in running state
+           Then Verify the pipeline status is "Succeeded"
+           Then Click on the Hamburger bar on the left panel
+           Then Click on Control Center link from the hamburger menu
+           Then Verify user is able to click on the dataset entity icon to see the details page of the dataset
+           Then Verify user is navigated to the details page of the dataset entity icon successfully
+
+           @BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
+           Scenario: Verify that User is able to perform Delete and truncate operation on dataset entity successfully.
+             Given Open Datafusion Project to configure pipeline
+             Then Click on the Hamburger bar on the left panel
+             Then Click on Control Center link from the hamburger menu
+             Then Click on the Plus Green Button to import the pipelines
+             Then Verify user is able to click on the create button to create a pipeline successfully
+             When Expand Plugin group in the LHS plugins list: "Source"
+             When Select plugin: "BigQuery" from the plugins list as: "Source"
+             When Expand Plugin group in the LHS plugins list: "Sink"
+             When Select plugin: "BigQuery" from the plugins list as: "Sink"
+             Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
+             Then Navigate to the properties page of plugin: "BigQuery"
+             And Enter input plugin property: "referenceName" with value: "ReferenceDataset"
+             And Replace input plugin property: "project" with value: "projectId"
+             And Enter input plugin property: "datasetProject" with value: "projectId"
+             And Replace input plugin property: "dataset" with value: "dataset"
+             Then Override Service account details if set in environment variables
+             And Enter input plugin property: "table" with value: "bqSourceTable"
+             Then Click on the Get Schema button
+             Then Validate "BigQuery" plugin properties
+             And Close the Plugin Properties page
+             Then Navigate to the properties page of plugin: "BigQuery2"
+             Then Replace input plugin property: "project" with value: "projectId"
+             Then Override Service account details if set in environment variables
+             Then Enter input plugin property: "datasetProject" with value: "projectId"
+             Then Enter input plugin property: "referenceName" with value: "BQReferenceNameDataset"
+             Then Enter input plugin property: "dataset" with value: "dataset"
+             Then Enter input plugin property: "table" with value: "bqTargetTable"
+             Then Validate "BigQuery" plugin properties
+             And Close the Plugin Properties page
+             Then Save the pipeline
+             Then Deploy the pipeline
+             Then Run the Pipeline in Runtime
+             Then Wait till pipeline is in running state
+             Then Verify the pipeline status is "Succeeded"
+             Then Click on the Hamburger bar on the left panel
+             Then Click on Control Center link from the hamburger menu
+             Then Click on the delete icon of the dataset entity and the dataset should get deleted successfully
+             Then Click on the truncate icon of the dataset entity and the dataset should get truncated successfully
+             Then Verify the deleted dataset "BQReferenceNameDataset" entity is not present in control center page
+
+  @BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
+    Scenario:Verify that User clicks on Dataset and view details page should be dispalyed,is able to click on view details link and navigate back to main details page and then close it.
+    Given Open Datafusion Project to configure pipeline
+    Then Click on the Hamburger bar on the left panel
+    Then Click on Control Center link from the hamburger menu
+    Then Click on the Plus Green Button to import the pipelines
+    Then Verify user is able to click on the create button to create a pipeline successfully
+    When Expand Plugin group in the LHS plugins list: "Source"
+    When Select plugin: "BigQuery" from the plugins list as: "Source"
+    When Expand Plugin group in the LHS plugins list: "Sink"
+    When Select plugin: "BigQuery" from the plugins list as: "Sink"
+    Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
+    Then Navigate to the properties page of plugin: "BigQuery"
+    And Enter input plugin property: "referenceName" with value: "ReferenceDataset"
+    And Replace input plugin property: "project" with value: "projectId"
+    And Enter input plugin property: "datasetProject" with value: "projectId"
+    And Replace input plugin property: "dataset" with value: "dataset"
+    Then Override Service account details if set in environment variables
+    And Enter input plugin property: "table" with value: "bqSourceTable"
+    Then Click on the Get Schema button
+    Then Validate "BigQuery" plugin properties
+    And Close the Plugin Properties page
+    Then Navigate to the properties page of plugin: "BigQuery2"
+    Then Replace input plugin property: "project" with value: "projectId"
+    Then Override Service account details if set in environment variables
+    Then Enter input plugin property: "datasetProject" with value: "projectId"
+    Then Enter input plugin property: "referenceName" with value: "BQReferenceNameDataset"
+    Then Enter input plugin property: "dataset" with value: "dataset"
+    Then Enter input plugin property: "table" with value: "bqTargetTable"
+    Then Validate "BigQuery" plugin properties
+    And Close the Plugin Properties page
+    Then Save the pipeline
+    Then Deploy the pipeline
+    Then Run the Pipeline in Runtime
+    Then Wait till pipeline is in running state
+    Then Verify the pipeline status is "Succeeded"
+    Then Click on the Hamburger bar on the left panel
+    Then Click on Control Center link from the hamburger menu
+    Then Verify user is able to click on the dataset entity icon to see the details page of the dataset
+    Then Click on the view details tab of dataset entity page to see the details page of the dataset
+    Then Verify user is successfully navigated to details page of the dataset entity
+    Then Click on the back link of the view details page of dataset entity
+    Then Click on the close link of the view details page of dataset entity to close the details page
+
+  @BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
+    Given Open Datafusion Project to configure pipeline
+    Then Click on the Hamburger bar on the left panel
+    Then Click on Control Center link from the hamburger menu
+    Then Click on the Plus Green Button to import the pipelines
+    Then Verify user is able to click on the create button to create a pipeline successfully
+    When Expand Plugin group in the LHS plugins list: "Source"
+    When Select plugin: "BigQuery" from the plugins list as: "Source"
+    When Expand Plugin group in the LHS plugins list: "Sink"
+    When Select plugin: "BigQuery" from the plugins list as: "Sink"
+    Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
+    Then Navigate to the properties page of plugin: "BigQuery"
+    And Enter input plugin property: "referenceName" with value: "ReferenceDatasetFilter"
+    And Replace input plugin property: "project" with value: "projectId"
+    And Enter input plugin property: "datasetProject" with value: "projectId"
+    And Replace input plugin property: "dataset" with value: "dataset"
+    Then Override Service account details if set in environment variables
+    And Enter input plugin property: "table" with value: "bqSourceTable"
+    Then Click on the Get Schema button
+    Then Validate "BigQuery" plugin properties
+    And Close the Plugin Properties page
+    Then Navigate to the properties page of plugin: "BigQuery2"
+    Then Replace input plugin property: "project" with value: "projectId"
+    Then Override Service account details if set in environment variables
+    Then Enter input plugin property: "datasetProject" with value: "projectId"
+    Then Enter input plugin property: "referenceName" with value: "BQReferenceNameDatasetFilter"
+    Then Enter input plugin property: "dataset" with value: "dataset"
+    Then Enter input plugin property: "table" with value: "bqTargetTable"
+    Then Validate "BigQuery" plugin properties
+    And Close the Plugin Properties page
+    Then Save the pipeline
+    Then Deploy the pipeline
+    Then Run the Pipeline in Runtime
+    Then Wait till pipeline is in running state
+    Then Verify the pipeline status is "Succeeded"
+    Then Click on the Hamburger bar on the left panel
+    Then Click on Control Center link from the hamburger menu
+    Then Verify user is able to see the display message on the basis of filter selection in control center page
+    Then Select dropdown : "Filter" with option value: "Artifacts" in control center
+    Then Verify user is able to see all entities displayed message on the basis of filter selection
+
+  @BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
+    Given Open Datafusion Project to configure pipeline
+    Then Click on the Hamburger bar on the left panel
+    Then Click on Control Center link from the hamburger menu
+    Then Click on the Plus Green Button to import the pipelines
+    Then Verify user is able to click on the create button to create a pipeline successfully
+    When Expand Plugin group in the LHS plugins list: "Source"
+    When Select plugin: "BigQuery" from the plugins list as: "Source"
+    When Expand Plugin group in the LHS plugins list: "Sink"
+    When Select plugin: "BigQuery" from the plugins list as: "Sink"
+    Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
+    Then Navigate to the properties page of plugin: "BigQuery"
+    And Enter input plugin property: "referenceName" with value: "ReferenceDatasetSchema"
+    And Replace input plugin property: "project" with value: "projectId"
+    And Enter input plugin property: "datasetProject" with value: "projectId"
+    And Replace input plugin property: "dataset" with value: "dataset"
+    Then Override Service account details if set in environment variables
+    And Enter input plugin property: "table" with value: "bqSourceTable"
+    Then Click on the Get Schema button
+    Then Validate "BigQuery" plugin properties
+    And Close the Plugin Properties page
+    Then Navigate to the properties page of plugin: "BigQuery2"
+    Then Replace input plugin property: "project" with value: "projectId"
+    Then Override Service account details if set in environment variables
+    Then Enter input plugin property: "datasetProject" with value: "projectId"
+    Then Enter input plugin property: "referenceName" with value: "BQReferenceNameDatasetSchema"
+    Then Enter input plugin property: "dataset" with value: "dataset"
+    Then Enter input plugin property: "table" with value: "bqTargetTable"
+    Then Validate "BigQuery" plugin properties
+    And Close the Plugin Properties page
+    Then Save the pipeline
+    Then Deploy the pipeline
+    Then Run the Pipeline in Runtime
+    Then Wait till pipeline is in running state
+    Then Verify the pipeline status is "Succeeded"
+    Then Click on the Hamburger bar on the left panel
+    Then Click on Control Center link from the hamburger menu
+    Then Verify user is able to click on the dataset entity icon to see the details page of the dataset
+    Then Verify user is navigated to the details page of the dataset entity icon successfully
+    Then Click on the schema link of the dataset entity details page
+    Then Verify user is navigated to the schema details page of the dataset entity page
+    Then Click on the programs link of the dataset entity details page
+    Then Verify user is navigated to the programs details page of the dataset entity page
+
diff --git a/cdap-e2e-tests/src/e2e-test/resources/pluginDataCyAttributes.properties b/cdap-e2e-tests/src/e2e-test/resources/pluginDataCyAttributes.properties
@@ -2,3 +2,5 @@ projectId=project
 datasetProjectId=datasetProject
 referenceName=referenceName
 table=table
+Filter=filter-dropdown
+Artifcats=Artifacts-input