e2e-testcases Related to LookUp Plugin #6
Conversation
| Then Enter input plugin property: "dataset" with value: "dataset" | ||
| Then Enter input plugin property: "table" with value: "bqSourceTable" | ||
| Then Click on the Get Schema button | ||
| Then Capture the generated Output Schema |
There was a problem hiding this comment.
This step is needed only when we validate columns in preview data. Nor required in this scenario.
Check in all scenarios. Add only if needed.
| Then Verify that the Plugin is displaying an error message: "errorMessageLookUpWithLookupValueFieldNotFound" on the header | ||
|
|
||
| @BQ_SOURCE_LOOKUP_TEST @GCS_CSV_LOOKUP_TEST @BQ_SINK_TEST | ||
| Scenario:Verify LookUp plugin error when select all Lookup datasets |
There was a problem hiding this comment.
nit : spaces between words
Check description in all scenarios and features.
| Then Enter input plugin property: "Lookupvaluefield" with value: "lookUpValueField" | ||
| Then Enter input plugin property: "Outputfield" with value: "lookUpOutputField" | ||
| Then Click on the Validate button | ||
| Then Verify that the Plugin is displaying an error message: "LookUpPluginErrorWhenSelectAllLookUpDatasets" on the header |
| Feature: LookUp - Verification of LookUp Plugin pipeline with BigQuery and GCS as source and BigQuery as target | ||
|
|
||
| @BQ_SOURCE_LOOKUP_TEST @GCS_CSV_LOOKUP_TEST @BQ_SINK_TEST | ||
| Scenario: To verify complete flow of data extract and transfer from BigQuery and GCS as source to target BigQuery2 with LookUp plugin using GCS lookup dataset. |
| Then Open and capture pipeline preview logs | ||
| Then Verify the preview run status of pipeline in the logs is "succeeded" | ||
| Then Close the pipeline logs | ||
| Then Click on the Preview Data link on the Sink plugin node: "BigQueryTable" |
There was a problem hiding this comment.
Add appropriate validation step ->
Either
Verify preview output schema matches the outputSchema captured in properties
Or
Verify sink plugin's Preview Data for Input Records table and the Input Schema matches the Output Schema of Source plugin
Same comment for next scenarios with BigQuery lookup dataset and without output field
| targetFieldName=targetField | ||
| targetFieldDateFormat=targetFormat | ||
| sourceInSecondsOrMilliseconds=secondsOrMilliseconds | ||
| Lookupdataset=lookupDataset |
There was a problem hiding this comment.
camelCase properties , Check all.
i.e Lookupdataset -> lookUpDataset
| ## LOOKUP-PLUGIN-PROPERTIES-START | ||
| lookUpmBQCreateTableQueryFile=testdata/BigQuery/bqLookupCreateTableQuery.txt | ||
| lookUpmBQInsertQueryFile=testdata/BigQuery/bqLookUpInsertQuery.txt | ||
| lookUpmBQCreateTableQueryFile1=testdata/BigQuery/bqLookUpCreateTableQuery1.txt |
| ## DateTransform-PLUGIN-PROPERTIES-END | ||
|
|
||
| ## LOOKUP-PLUGIN-PROPERTIES-START | ||
| lookUpmBQCreateTableQueryFile=testdata/BigQuery/bqLookupCreateTableQuery.txt |
| lookUpOutputField1=name | ||
| lookUpGCSCsvFile=testdata/file/GCS_CSV_LOOKUP.csv | ||
| Lookupdataset=BigQuery | ||
| Inputkeyfield=Customer_BloodGroup |
| lookUpValueField1=First_name | ||
| lookUpOutputField1=name | ||
| lookUpGCSCsvFile=testdata/file/GCS_CSV_LOOKUP.csv | ||
| Lookupdataset=BigQuery |
|
Lookup is not under hydrator repo. Lookup plugin repo link : |
@sawantpritam Please Review