Skip to content

Latest commit

 

History

History
1451 lines (1341 loc) · 213 KB

File metadata and controls

1451 lines (1341 loc) · 213 KB

Package apache-airflow-providers-google

Google services including:

This is detailed commit list of changes for versions provider package: google. For high-level changelog, see :doc:`package information including changelog <index>`.

10.0.0

Latest change: 2023-04-21

Commit Committed Subject
fbc1382514 2023-04-21 remove delegate_to from GCP operators and hooks (#30748)
b48f959ae9 2023-04-21 Update DataprocCreateCluster operator to use 'label' parameter properly (#30741)
da2749cae5 2023-04-15 Update Google Campaign Manager360 operators to use API v4 (#30598)
4eab616e9f 2023-04-15 add missing project_id in BigQueryGetDataOperator (#30651)
57c09e59ee 2023-04-14 Display Video 360 cleanup v1 API usage (#30577)

9.0.0

Latest change: 2023-04-12

Commit Committed Subject
0f3b6579cb 2023-04-12 Prepare docs for RC2 of provider wave (#30606)
874ea9588e 2023-04-09 Prepare docs for ad hoc release of Providers (#30545)
71db47a73d 2023-04-09 Update DV360 operators to use API v2 (#30326)
3d2c96e3f5 2023-04-08 Add deferrable mode to GKEStartPodOperator (#29266)
4703f9a0e5 2023-04-08 BigQueryHook list_rows/get_datasets_list can return iterator (#30543)
d9896fd96e 2023-04-08 Fix dynamic imports in google ads vendored in library (#30544)
d23a3bbed8 2023-04-04 Add mechanism to suspend providers (#30422)
2ba1e63c37 2023-04-04 Fix cloud build async credentials (#30441)
cc6fd5c0d9 2023-04-03 Small quotation fix (#30448)

8.12.0

Latest change: 2023-04-02

Commit Committed Subject
55dbf1ff1f 2023-04-02 Prepare docs for April 2023 wave of Providers (#30378)
25048fa6b2 2023-04-01 Switch to using vendored-in google ads. (#30410)
2e65c70e99 2023-04-01 Merging of the google ads vendored-in code. (#30399)
540a076801 2023-03-30 merge BigQueryTableExistenceAsyncSensor into BigQueryTableExistenceSensor (#30235)
29eba167ea 2023-03-22 Merge BigQueryTableExistencePartitionAsyncSensor into BigQueryTableExistencePartitionSensor (#30231)
79a2fa7db9 2023-03-21 Merge GCSObjectExistenceAsyncSensor logic to GCSObjectExistenceSensor (#30014)
af4627fec9 2023-03-20 fix setting project_id for gs to bq and bq to gs (#30053)
75fd5e8c54 2023-03-16 Add missing 'poll_interval' in Bigquery operator (#30132)
5a3be7256b 2023-03-15 Handling project location param on async BigQuery dts trigger (#29786)
a6715805c7 2023-03-14 Add poll_interval param in BigQueryInsertJobOperator (#30091)
57fb80cff0 2023-03-14 Support CloudDataTransferServiceJobStatusSensor without specifying a project_id (#30035)
def1f89e70 2023-03-10 Fix location on cloud build operators (#29937)
599c587e26 2023-03-10 Add 'job_id' to 'BigQueryToGCSOperator' templated_fields (#30006)
c3867781e0 2023-03-08 adding trigger info to provider yaml (#29950)
b6392ae5fd 2023-03-07 Support deleting the local log files when using remote logging (#29772)
464ab1b7ca 2023-03-05 Wait insert_job result in normal mode (#29925)
f55b9576b1 2023-03-05 'GoogleDriveHook': Fixing log message + adding more verbose documentation (#29694)
035ad26d79 2023-03-04 Add "BOOLEAN" to type_map of MSSQLToGCSOperator, fix incorrect bit->int type conversion by specifying BIT fields explicitly (#29902)
5a632f78eb 2023-03-04 Google Cloud Providers - Fix _MethodDefault deepcopy failure (#29518)
971039454a 2023-03-04 Align cncf provider file names with AIP-21 (#29905)
864ff2e3ce 2023-03-04 Remove unnecessary upper constraints from google provider (#29915)

8.11.0

Latest change: 2023-03-03

Commit Committed Subject
fcd3c0149f 2023-03-03 Prepare docs for 03/2023 wave of Providers (#29878)
3fc9461654 2023-03-03 Add 'CloudSQLCloneInstanceOperator' (#29726)
47ab0ca629 2023-03-03 Move help message to the google auth code (#29888)
972fca2253 2023-02-28 Fix 'NoneType' object is not subscriptable. (#29820)
ec844eaa0a 2023-02-27 Add deferrable mode to BigQueryTablePartitionExistenceSensor. (#29735)
a5adb87ab4 2023-02-26 Add a new param for BigQuery operators to support additional actions when resource exists (#29394)
1e7c064560 2023-02-25 Google Cloud Providers - Introduce GoogleCloudBaseOperator (#29680)
ad08f66228 2023-02-22 Remove <2.0.0 limit on google-cloud-bigtable (#29644)
dba390e323 2023-02-22 Fix and augment 'check-for-inclusive-language' CI check (#29549)
f51742d20b 2023-02-21 Don't push secret in XCOM in BigQueryCreateDataTransferOperator (#29348)
3dbcf99d20 2023-02-21 Update google cloud dlp package and adjust hook and operators (#29234)
6ef5ba9104 2023-02-20 Refactor Dataproc Trigger (#29364)
7e3a9fc858 2023-02-20 Dataproc batches (#29136)
1677d80e65 2023-02-20 Add deferrable mode to DataprocInstantiateWorkflowTemplateOperator (#28618)

8.10.0

Latest change: 2023-02-18

Commit Committed Subject
470fdaea27 2023-02-18 Prepare docs for 02 2023 midmonth wave of Providers (#29589)
f37772adfd 2023-02-18 'GoogleDriveHook': Add folder_id param to upload_file (#29477)
28126c12fb 2023-02-14 Add defer mode to GKECreateClusterOperator and GKEDeleteClusterOperator (#28406)
32c571e592 2023-02-14 Move cloud_sql_binary_path from connection to Hook (#29499)
41fade2d21 2023-02-13 Upgrade Mypy to 1.0 (#29468)
5e6f8eb4d5 2023-02-13 Check that cloud sql provider version is valid (#29497)
f9e9d23457 2023-02-11 Restore trigger logging (#29482)
7ee1a56244 2023-02-11 Add documentation for BigQuery transfer operators (#29466)
60d4bcd1d1 2023-02-10 Revert "Enable individual trigger logging (#27758)" (#29472)
6c1eeb5839 2023-02-11 Revert "Upgrade mypy to 0.991 (#28926)" (#29470)
6ae0a80cba 2023-02-11 Upgrade mypy to 0.991 (#28926)

8.9.0

Latest change: 2023-02-08

Commit Committed Subject
ce6ae2457e 2023-02-08 Prepare docs for Feb 2023 wave of Providers (#29379)
1b18a501fe 2023-02-03 Enable individual trigger logging (#27758)
872df121e2 2023-02-03 Add deferrable capability to existing ''DataprocDeleteClusterOperator'' (#29349)
094d6bf01b 2023-01-30 Add deferrable mode to dataflow operators (#27776)
9d9351728c 2023-01-30 Add deferrable mode to DataprocCreateBatchOperator (#28457)
9fd80130e2 2023-01-25 Add deferrable mode to DataprocCreateClusterOperator and DataprocUpdateClusterOperator (#28529)
02bebf897b 2023-01-25 Add deferrable mode to MLEngineStartTrainingJobOperator (#27405)
cf90a1a567 2023-01-25 Keyfile dict can be dict not str (#29135)
b4c50dadd3 2023-01-24 GCSTaskHandler may use remote log conn id (#29117)
b2825e1185 2023-01-24 Fix GoogleDriveHook writing files to trashed folders on upload v2 (#29119)
be0e35321f 2023-01-24 fix Google provider CHANGELOG.rst (#29122)
3374fdfcbd 2023-01-23 Deprecate 'delegate_to' param in GCP operators and update docs (#29088)
7e2493e3c8 2023-01-23 fix Google provider CHANGELOG.rst (#29114)
90e6277da6 2023-01-23 Auto ML assets (#25466)
e926bb9bb0 2023-01-20 Add deferrable mode to DataFusionStartPipelineOperator (#28690)
5fcdd321c5 2023-01-20 Add deferrable mode for Big Query Transfer operator (#27833)
5350be2194 2023-01-19 Add support for write_on_empty in BaseSQLToGCSOperator (#28959)
dc3a3c7c52 2023-01-16 Add DataprocCancelOperationOperator (#28456)

8.8.0

Latest change: 2023-01-14

Commit Committed Subject
911b708ffd 2023-01-14 Prepare docs for Jan 2023 mid-month wave of Providers (#28929)
ce858a5d71 2023-01-12 Switch to ruff for faster static checks (#28893)
f1eb2f1af4 2023-01-12 'BigQueryCreateExternalTableOperator' fix field delimiter not working with csv (#28856)
a337e6209a 2023-01-11 Fix using private _get_credentials instead of public get_credentials (#28588)
284cd52989 2023-01-10 Add deferrable ''GCSObjectExistenceSensorAsync'' (#28763)
35a8ffc55a 2023-01-10 Support partition_columns in BaseSQLToGCSOperator (#28677)
c0b2fcff24 2023-01-09 assign "datasetReference" attribute to dataset_reference dict. by default if not already set in create_empty_dataset method of bigquery hook (#28782)
71306b31f1 2023-01-09 Fix'GoogleCampaignManagerReportSensor' with 'QUEUED' status (#28735)
c67f4af667 2023-01-09 Fix BigQueryColumnCheckOperator runtime error (#28796)

8.7.0

Latest change: 2023-01-02

Commit Committed Subject
5246c009c5 2023-01-02 Prepare docs for Jan 2023 wave of Providers (#28651)
fec1460eb7 2023-01-01 Push job_id in xcom for dataproc submit job op (#28639)
0fae6a0c9e 2022-12-28 Add table_resource to template fields for BigQueryCreateEmptyTableOperator (#28235)
d7f5f6d737 2022-12-24 GCSToBigQueryOperator allows autodetect None and infers schema (#28564)
034039beb2 2022-12-24 Remove 'pylint' messages control instructions (#28555)
8fb7be2fb5 2022-12-22 Set bigquery ''use_legacy_sql'' param in job config correctly (#28522)
23264fb820 2022-12-21 Fix for issue with reading schema fields for JSON files in GCSToBigQueryOperator (#28284)
7950fb9711 2022-12-21 Remove deprecated AIPlatformConsoleLinkk from google/provider.yaml (#28449)
820f5a9374 2022-12-20 Use object instead of array in config.yml for config template (#28417)
9eacf607be 2022-12-20 Fix GCSToBigQueryOperator not respecting schema_obj (#28444)
bdf3175e96 2022-12-06 Improve memory usage in Dataproc deferrable operators (#28117)
3fef462838 2022-12-06 Fix GCSToGCSOperator copying list of objects without wildcard (#28111)
2d663df055 2022-12-04 Fix: re-enable use of parameters in gcs_to_bq which had been disabled (#27961)
5cdff50557 2022-12-04 Add retry param in GCSObjectExistenceSensor (#27943)
8f98bfeb53 2022-12-03 Add preserveAsciiControlCharacters to src_fmt_configs (#27679)
4a3a429658 2022-12-03 [misc] Get rid of 'pass' statement in conditions (#27775)
6b3bb3c3e9 2022-12-03 Change log level to DEBUG when secret not found for google secret manager (#27856)
527b948856 2022-12-03 [misc] Replace XOR '^' conditions by 'exactly_one' helper in providers (#27858)
c931d88893 2022-12-03 Add deferrable mode to CloudBuildCreateBuildOperator (#27783)

8.6.0

Latest change: 2022-11-26

Commit Committed Subject
25bdbc8e67 2022-11-26 Updated docs for RC3 wave of providers (#27937)
f0820e8d9e 2022-11-25 Add Export Format to Template Fields in BigQueryToGCSOperator (#27910)
2e20e9f7eb 2022-11-24 Prepare for follow-up relase for November providers (#27774)
80c327bd3b 2022-11-24 Bump common.sql provider to 1.3.1 (#27888)
bc0063af99 2022-11-16 Fix to read location parameter properly in BigQueryToBigQueryOperator (#27661)
0cb6450d6d 2022-11-16 Persist DataprocLink for workflow operators regardless of job status (#26986)
ddbc758540 2022-11-16 Deferrable mode for BigQueryToGCSOperator (#27683)

8.5.0

Latest change: 2022-11-15

Commit Committed Subject
12c3c39d1a 2022-11-15 pRepare docs for November 2022 wave of Providers (#27613)
00af5c007e 2022-11-14 Replace urlparse with urlsplit (#27389)
1059de6294 2022-11-11 Dataform operators, links, update system tests and docs (#27144)
3aed495f50 2022-11-11 Rename hook bigquery function '_bq_cast' to 'bq_cast' (#27543)
e8ab8ccc0e 2022-11-11 Add backward compatibility with old versions of Apache Beam (#27263)
59e3198f7e 2022-11-10 Change dataprep system tests assets (#26488)
98a9c574e3 2022-11-08 set project_id and location when canceling BigQuery job (#27521)
a691ab56a6 2022-11-08 Add new Compute Engine Operators and fix system tests (#25608)
199359bb38 2022-11-07 Use non-deprecated method for on_kill in BigQueryHook (#27547)
7297892558 2022-11-07 Remove unnecessary newlines around single arg in signature (#27525)
5cd78cf425 2022-11-06 Upgrade dependencies in order to avoid backtracking (#27531)
332c01d6e0 2022-10-31 Allow values in WorkflowsCreateExecutionOperator execution argument to be dicts (#27361)
50d217a129 2022-10-31 DataflowStopJobOperator Operator (#27033)
eb8c0cf0d2 2022-10-31 Migration of System Tests: Cloud Composer (AIP-47) (#27227)
528ecbbc00 2022-10-31 Rewrite system tests for ML Engine service (#26915)
bcb026bf7c 2022-10-31 use the proper key to retrieve the dataflow job_id (#27336)
42841f70d5 2022-10-31 Migration of System Tests: Cloud BigQuery Data Transfer (AIP-47) (#27312)
1447158e69 2022-10-31 Typecast biquery job response col value (#27236)
95e5675714 2022-10-31 Migration of System Tests: Dataplex (AIP-47) (#26989)
124fb3948d 2022-10-31 Add deferrable mode to GCPToBigQueryOperator + tests (#27052)
7a7c5f8fc4 2022-10-31 Add system tests for Vertex AI operators in new approach (#27053)
4e55d7fa2b 2022-10-31 Migration of System Tests: Cloud Vision Operators (AIP-47) (#26963)
896479d1a0 2022-10-31 Google Drive to local - system tests migrations (AIP-47) (#26798)
3d5f34cb0f 2022-10-28 Allow and prefer non-prefixed extra fields for dataprep hook (#27039)
04f674c13b 2022-10-27 Migrate Bigtable operators system tests according to AIP-47 (#26911)
58d61826a3 2022-10-27 Migrate Dataproc Metastore system tests according to AIP-47 (#26858)
9ab1a6a3e7 2022-10-27 Update old style typing (#26872)
87eb46bbc6 2022-10-26 Common sql bugfixes and improvements (#26761)
7653c61df8 2022-10-26 Make GSheetsHook return an empty list when there are no values (#27261)
78b8ea2f22 2022-10-24 Move min airflow version to 2.3.0 for all providers (#27196)
2a34dc9e84 2022-10-23 Enable string normalization in python formatting - providers (#27205)
58378cfd42 2022-10-23 Cloud ML Engine operators assets (AIP-47) (#26836)
de9633f93a 2022-10-22 Update google hooks to prefer non-prefixed extra fields (#27023)
b54a2de8c7 2022-10-09 Local filesystem to Google Drive Operator - system tests migration (AIP-47) (#26797)
b4cef6da21 2022-10-09 SFTP to Google Cloud Storage Transfer system tests migration (AIP-47) (#26799)
6f0b600293 2022-10-09 Fix delay in Dataproc CreateBatch operator (#26126)
2f326a6c03 2022-10-06 Remove <2 limit on google-cloud-storage (#26922)
a67bcf3eca 2022-10-06 Allow for the overriding of stringify_dict for json/jsonb column data type in Postgres #26875 (#26876)

8.4.0

Latest change: 2022-10-04

Commit Committed Subject
403ed7163f 2022-10-04 Add docs for Google/Slack RC providers (#26860)
fa0cb363b8 2022-10-01 Correcting the transfer config name. (#25719)
cee610ae5c 2022-10-01 Fix parsing of optional 'mode' field in BigQuery Result Schema (#26786)
b7203cd36e 2022-10-01 Fix MaxID logic for GCSToBigQueryOperator (#26768)
f8db64c35c 2022-09-28 Update docs for September Provider's release (#26731)
dce27557eb 2022-09-28 Fix GCS sensor system tests failing with DebugExecutor (#26742)
26f94c5370 2022-09-26 Cloud Data Loss Prevention Operators assets (#26618)
01ac40af75 2022-09-22 Update gcs.py (#26570)
e61d823f18 2022-09-21 Cloud Storage Transfer Operators assets & system tests migration (AIP-47) (#26072)
a60e3b9317 2022-09-21 Migrate Data Loss Prevention system tests according to AIP-47 (#26060)
c4256ca1a0 2022-09-21 Add BigQuery Column and Table Check Operators (#26368)
4c33f6bcf5 2022-09-20 Merge deferrable BigQuery operators to exisitng one (#26433)
8e98b1c6df 2022-09-20 Google Drive to Google Cloud Storage Transfer Operator - system tests migration (AIP-47) (#26487)
e315900396 2022-09-20 specifying project id when calling wait_for_operation in delete/create cluster (#26418)
6045f7ad69 2022-09-19 Cloud Functions Operators assets & system tests migration (AIP-47) (#26073)
1f7b296227 2022-09-18 Auto tail file logs in Web UI (#26169)
07fe356de0 2022-09-18 GCSToBigQueryOperator Resolve 'max_id_key' job retrieval and xcom return (#26285)
b4f8a069f0 2022-09-18 Allow for the overriding of 'stringify_dict' for json export format on BaseSQLToGCSOperator (#26277)
706a618014 2022-09-18 Append GoogleLink base in the link class (#26057)
97b144fbed 2022-09-18 Fix JSONDecodeError in Datafusion operators (#26202)
9444d9789b 2022-09-14 Work around pyupgrade edge cases (#26384)
d67ac5932d 2022-09-14 Apply PEP-563 (Postponed Evaluation of Annotations) to core airflow (#26290)
06acf40a43 2022-09-13 Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)
23ad7e292a 2022-09-10 Cloud Video Intelligence Operators assets & system tests migration (AIP-47) (#26132)
3a539ff663 2022-09-09 Life Science assets & system tests migration (AIP-47) (#25548)
5066844513 2022-09-09 D400 first line should end with period batch02 (#25268)
f938cd4fc8 2022-09-08 Add deferrable big query operators and sensors (#26156)
8cac96918b 2022-09-07 GCSToBigQueryOperator allow for schema_object in alternate GCS Bucket (#26190)
12cbc0f1dd 2022-09-07 Don't throw an exception when a BQ cusor job has no schema (#26096)
8acdc2a834 2022-08-30 Replace SQL with Common SQL in pre commit (#26058)
1d06374194 2022-08-30 Hook into Mypy to get rid of those cast() (#26023)
da8f133053 2022-08-29 Use AsyncClient for Composer Operators in deferrable mode (#25951)
1ed014647e 2022-08-29 Add 'output' property to MappedOperator (#25604)
d4eb60712d 2022-08-27 Use project_id to get authenticated client (#25984)
4c3fb1ff2b 2022-08-27 Google Cloud Tasks Sensor for queue being empty (#25622)
c81178063a 2022-08-27 Cloud Build assets & system tests migration (AIP-47) (#25895)
62a46c1e18 2022-08-27 Added append_job_name parameter to DataflowTemplatedJobStartOperator (#25746)
15b49add28 2022-08-23 Sql to GSC operators update docs for parquet format (#25878)
25a9ae3b2e 2022-08-23 Limit Google Protobuf for compatibility with biggtable client (#25886)
ecf0460b7d 2022-08-22 Dataproc submit job operator async (#25302)
fc6dfa338a 2022-08-20 Support project_id argument in BigQueryGetDataOperator (#25782)
6e66dd7776 2022-08-19 Make GoogleBaseHook credentials functions public (#25785)
6e41c7eb33 2022-08-16 Fixed never ending loop to in CreateWorkflowInvocation (#25737)
6c5b0776c0 2022-08-14 Adding a parameter for exclusion of trashed files in GoogleDriveHook (#25675)
1b412c9cbe 2022-08-10 Consolidate to one 'schedule' param (#25410)

8.3.0

Latest change: 2022-08-10

Commit Committed Subject
e5ac6c7cfb 2022-08-10 Prepare docs for new providers release (August 2022) (#25618)
2e2d4bffd5 2022-08-09 Dataform operators (#25587)
c8c4a42723 2022-08-08 Fix GCSListObjectsOperator docstring (#25614)
029e3ae96f 2022-08-05 Remove deprecated modules (#25543)
7d2c2ee879 2022-08-04 add description method in BigQueryCursor class (#25366)
e84d753015 2022-08-04 Fix BigQueryInsertJobOperator cancel_on_kill (#25342)
803c0e252f 2022-08-03 Fix BaseSQLToGCSOperator approx_max_file_size_bytes (#25469)
faf3c4fe47 2022-08-02 Fix PostgresToGCSOperat bool dtype (#25475)
c8cacad4d6 2022-08-02 Migrate Google example trino_to_gcs to new design AIP-47 (#25420)
d2900022a2 2022-08-02 Migrate Google example automl_nl_text_extraction to new design AIP-47 (#25418)
acab8f52dd 2022-07-29 Move all "old" SQL operators to common.sql providers (#25350)
f6b48ac6df 2022-07-28 Memorystore assets & system tests migration (AIP-47) (#25361)
f4b93cc097 2022-07-28 Translate system tests migration (AIP-47) (#25340)
a8e4519815 2022-07-28 Fix Vertex AI Custom Job training issue (#25367)
5d4abbd58c 2022-07-27 Deprecate hql parameters and synchronize DBApiHook method APIs (#25299)
8bc147192c 2022-07-27 Fix Flask Login user setting for Flask 2.2 and Flask-Login 0.6.2 (#25318)
28db8c10b2 2022-07-26 Migrate Google example life_sciences to new design AIP-47 (#25264)
10c9a3697a 2022-07-26 Migrate Google example natural_language to new design AIP-47 (#25262)
b288bf4da4 2022-07-26 Delete redundant system test bigquery_to_bigquery (#25261)
c8af0592c0 2022-07-26 Improve taskflow type hints with ParamSpec (#25173)
df00436569 2022-07-22 Unify DbApiHook.run() method with the methods which override it (#23971)
66b3ca1d28 2022-07-21 Migrate Google example bigquery_to_mssql to new design AIP-47 (#25174)
9644451676 2022-07-19 Migrate Google example compute_igm to new design AIP-47 (#25132)
3a80b36ed9 2022-07-19 Migrate Google example automl_vision to new design AIP-47 (#25152)
c0ce8a8375 2022-07-18 Migrate Google example gcs_to_sftp to new design AIP-47 (#25107)
e32e9c5880 2022-07-18 Bump typing-extensions and mypy for ParamSpec (#25088)
4473b27d08 2022-07-16 Migrate Google campaign manager example to new design AIP-47 (#25069)
9b7e4a7324 2022-07-16 Migrate Google analytics example to new design AIP-47 (#25006)
77626b7fc8 2022-07-13 Add project_id as a templated variable in two BQ operators (#24768)

8.2.0

Latest change: 2022-07-13

Commit Committed Subject
d2459a241b 2022-07-13 Add documentation for July 2022 Provider's release (#25030)
93992f2361 2022-07-12 PubSub assets & system tests migration (AIP-47) (#24867)
a13c51e224 2022-07-12 Migrate Google sheets example to new design AIP-47 (#24975)
a038b52b5a 2022-07-12 Migrate Google ads example to new design AIP-47 (#24941)
c618da444e 2022-07-12 Modify BigQueryCreateExternalTableOperator to use updated hook function (#24363)
626d9db290 2022-07-12 Migrate Google example gcs_to_gdrive to new design AIP-47 (#24949)
fb51e04cfd 2022-07-12 Migrate Google firestore example to new design AIP-47 (#24830)
b777514253 2022-07-12 Add handling state of existing Dataproc batch (#24924)
acaa0635c8 2022-07-08 Automatically detect if non-lazy logging interpolation is used (#24910)
fb7162418e 2022-07-07 Add links for Google Kubernetes Engine operators (#24786)
46bbfdade0 2022-07-07 Move all SQL classes to common-sql provider (#24836)
80b6754746 2022-07-06 Migrate Google example sql_to_sheets to new design AIP-47 (#24814)
3b35325840 2022-07-06 Add test_connection method to 'GoogleBaseHook' (#24682)
96b01a8012 2022-07-05 Remove "bad characters" from our codebase (#24841)
9227d56e68 2022-07-04 Datacatalog assets & system tests migration (AIP-47) (#24600)
fe13eae3bf 2022-07-04 perf(BigQuery): pass table_id as str type (#23141)
37ea530cb7 2022-07-04 Migrate Google example DAG mssql_to_gcs to new design AIP-47 (#24541)
46ac083f7e 2022-07-01 Align Black and blacken-docs configs (#24785)
0de31bd73a 2022-06-29 Move provider dependencies to inside provider folders (#24672)
45b11d4ed1 2022-06-29 Use our yaml util in all providers (#24720)
510a6bab45 2022-06-28 Remove 'hook-class-names' from provider.yaml (#24702)
7a7ca50160 2022-06-28 Migrate Google example DAG s3_to_gcs to new design AIP-47 (#24641)
abb304c92f 2022-06-25 Migrate Google example DAG bigquery_transfer to new design AIP-47 (#24543)
ded22eb5b6 2022-06-24 Add gcp_conn_id argument to GoogleDriveToLocalOperator (#24622)
e2f19505bf 2022-06-22 Upgrade FAB to 4.1.1 (#24399)
9c59831ee7 2022-06-21 Update providers to use functools compat for ''cached_property'' (#24582)
88ddf65708 2022-06-20 Migrate Google example DAG oracle_to_gcs to new design AIP-47 (#24542)
32fc4be502 2022-06-20 Migrate Google example DAG mysql_to_gcs to new design AIP-47 (#24540)
a35f342833 2022-06-20 Migrate Google search_ads DAG to new design AIP-47 (#24298)
e7a1c50d62 2022-06-20 GCSDeleteObjectsOperator empty prefix bug fix (#24353)
dd35fdaf35 2022-06-20 Migrate Google gcs_to_sheets DAG to new design AIP-47 (#24501)
0561c1aac4 2022-06-19 Add DeprecationWarning for column_transformations parameter in AutoML (#24467)

8.1.0

Latest change: 2022-06-15

Commit Committed Subject
952a5ea8d8 2022-06-15 Update release docs for Google and Oracle providers (#24461)
ce50d3731a 2022-06-15 Use insert_job in the BigQueryToGCPOpertor and adjust links (#24416)
2a084ee8d7 2022-06-14 Update Oracle library to latest version (#24311)
69c46252dd 2022-06-14 fix typo in google provider additional extras (#24431)
08b675cf66 2022-06-13 Fix links to sources for examples (#24386)
94257f48f4 2022-06-13 Expose SQL to GCS Metadata (#24382)
8e0bddaea6 2022-06-12 Deprecate remaining occurrences of 'bigquery_conn_id' in favor of 'gcp_conn_id' (#24376)
6eb60f816c 2022-06-12 Migrate Google calendar example DAG to new design AIP-47 (#24333)
bc3fc8c9fc 2022-06-12 Migrate Google azure_fileshare example DAG to new design AIP-47 (#24349)
6ab02b69a0 2022-06-12 Remove bigquery example already migrated to AIP-47 (#24379)
cb90ca7afb 2022-06-12 Migrate Google sheets example DAG to new design AIP-47 (#24351)

8.0.0

Latest change: 2022-06-09

Commit Committed Subject
dcdcf3a2b8 2022-06-09 Update release notes for RC2 release of Providers for May 2022 (#24307)
047a6162b0 2022-06-08 Workaround job race bug on biguery to gcs transfer (#24330)
717a7588bc 2022-06-07 Update package description to remove double min-airflow specification (#24292)
b1ad017cee 2022-06-07 pydocstyle D202 added (#24221)
aeabe994b3 2022-06-07 Prepare docs for May 2022 provider's release (#24231)
c3a9ef1ada 2022-06-07 AIP-47 - Migrate google leveldb DAGs to new design ##22447 (#24233)
c23826915d 2022-06-07 Apply per-run log templates to log handlers (#24153)
80c1ce76e1 2022-06-06 Cloud Storage assets & StorageLink update (#23865)
ec84ffe71c 2022-06-06 Fix GCSToGCSOperator cannot copy a single file/folder without copying other files/folders with that prefix (#24039)
027b707d21 2022-06-05 Add explanatory note for contributors about updating Changelog (#24229)
55fd02a389 2022-06-04 Add key_secret_project_id parameter which specifies a project with KeyFile (#23930)
90233bc7cb 2022-06-04 Added impersonation_chain for DataflowStartFlexTemplateOperator and DataflowStartSqlJobOperator (#24046)
c01a5a50b4 2022-06-04 Fix BigQuery system tests (#24013)
a597a76e8f 2022-06-03 fix BigQueryInsertJobOperator (#24165)
e13b15946e 2022-06-03 Workflows assets & system tests migration (AIP-47) (#24105)
368f292ca1 2022-06-03 Update credentials when using ADC in Compute Engine (#23773)
96e8fb4a07 2022-06-01 Fix the link to google workplace (#24080)
3dd7b1ddba 2022-06-01 set color to operators in cloud_sql.py (#24000)
841ed27101 2022-06-01 Spanner assets & system tests migration (AIP-47) (#23957)
fedab9d64a 2022-06-01 Remove hack from BigQuery DTS hook (#23887)
e58985598f 2022-05-30 Ensure @contextmanager decorates generator func (#23103)
92ddcf4ac6 2022-05-27 Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873)
ec6761a5c0 2022-05-23 Clean up f-strings in logging calls (#23597)
65f3b18fc1 2022-05-22 Sql to gcs with exclude columns (#23695)
a43e98d050 2022-05-22 Fix DataprocJobBaseOperator not being compatible with dotted names (#23439). (#23791)
5bfacf81c6 2022-05-20 [Issue#22846] allow option to encode or not encode UUID when uploading from Cassandra to GCS (#23766)
f60fa98a2e 2022-05-19 Cloud SQL assets & system tests migration (AIP-47) (#23583)
d3b0880286 2022-05-17 Speech To Text assets & system tests migration (AIP-47) (#23643)
3bf9a1df38 2022-05-16 Add fields to CLOUD_SQL_EXPORT_VALIDATION. (#23724)
bc0dcddfb5 2022-05-12 Migrate Dataproc to new system tests design (#22777)

7.0.0

Latest change: 2022-05-12

Commit Committed Subject
75c60923e0 2022-05-12 Prepare provider documentation 2022.05.11 (#23631)
cd49a8b9f6 2022-05-11 [FEATURE] google provider - BigQueryInsertJobOperator log query (#23648)
60a1d9d191 2022-05-10 [FEATURE] google provider - split GkeStartPodOperator execute (#23518)
74557e41e3 2022-05-10 Add exportContext.offload flag to CLOUD_SQL_EXPORT_VALIDATION. (#23614)
428a439953 2022-05-09 Clean up in-line f-string concatenation (#23591)
766726f2e3 2022-05-09 Fix 'PostgresToGCSOperator' does not allow nested JSON (#23063)
82c244f9c7 2022-05-08 Fix GCSToGCSOperator ignores replace parameter when there is no wildcard (#23340)
627b5698ec 2022-05-04 Add Stackdriver assets and migrate system tests to AIP-47 (#23320)
3977e1798d 2022-05-04 CloudTasks assets & system tests migration (AIP-47) (#23282)
dfe0f75938 2022-05-04 TextToSpeech assets & system tests migration (AIP-47) (#23247)
2d109401b3 2022-05-04 Bump pre-commit hook versions (#22887)
427e14b763 2022-05-03 Fix code-snippets in google provider (#23438)
fa0cc7cec7 2022-05-02 Cleanup Google provider CHANGELOG.rst (#23390)
3f6d5eef42 2022-05-01 'DataprocHook': Remove deprecated function 'submit' (#23389)
511d0ee256 2022-04-30 Bigquery assets (#23165)
3f9845095e 2022-04-29 Remove redundant docstring in 'BigQueryUpdateTableSchemaOperator' (#23349)
0fcdc5e1fb 2022-04-29 'S3ToGCSOperator': Remove 'dest_gcs_conn_id' (#23348)
05ccfd42f2 2022-04-29 Dataproc: Remove default value of 'region' (#23350)
359dc58207 2022-04-29 Google provider: Remove 'bigquery_conn_id', 'google_cloud_storage_conn_id' (#23326)
c82b3b9466 2022-04-28 'GCSFileTransformOperator': New templated fields 'source_object', 'destination_object' (#23328)
9449a107f0 2022-04-28 'DatastoreHook': Remove 'datastore_conn_id' (#23323)
1f32603549 2022-04-28 update processor to fix broken download URLs (#23299)
8a7b61a8e4 2022-04-28 Migrate gcs to new system tests design (#22778)
72e2ea68a1 2022-04-27 'CloudBuildCreateBuildOperator': Remove deprecated 'body' parameter (#23263)
6cf0176f2a 2022-04-27 Remove deprecated parameters from PubSub operators: (#23261)
4d9c55c9d9 2022-04-27 Remove deprecated parameters from BigQueryHook: (#23269)
915b0c689e 2022-04-27 add missing docstring in 'BigQueryHook.create_empty_table' (#23270)
710eb6f3e6 2022-04-26 * 'CloudDatastoreImportEntitiesOperator' : Remove 'xcom_push'. Please use 'BaseOperator.do_xcom_push' (#23252)
2d569fdaf0 2022-04-26 Create links for Biqtable operators (#23164)
434ab5a03c 2022-04-26 'BigtableCreateInstanceOperator' & 'BigtableHook.create_instance' Remove 'replica_cluster_id', 'replica_cluster_zone'. (#23251)
5ca1f3bf70 2022-04-26 Dataproc : remove 'location' in favor of 'region' (#23250)
1416ac4195 2022-04-26 'PubSubPullSensor': Remove 'project' and 'return_immediately' (#23231)
06dfc2536c 2022-04-26 Remove deprecated 'params' from google operators (#23230)
37a7b27242 2022-04-26 'LookerStartPdtBuildOperator', 'LookerCheckPdtBuildSensor' : fix empty materialization id handling (#23025)
967140e6c3 2022-04-25 Add location support to BigQueryDataTransferServiceTransferRunSensor.
d6094e58ba 2022-04-25 Fix static checks
22ea28f23e 2022-04-25 Remove run_in_gke_cluster flag
c46d04eb2d 2022-04-25 Create system test for K8s and dataproc operators
35cbc89c3a 2022-04-25 Create Dataproc operators for GKE
27ad3b7827 2022-04-25 Remove 'GCSObjectsWtihPrefixExistenceSensor'
544d658921 2022-04-25 Change CloudDatastoreExportEntitiesLink to StorageLink
b3cc2f5d10 2022-04-25 Fix pre-commit check
43ded6c877 2022-04-25 Add links for Cloud Datastore operators
de65a5cc5a 2022-04-25 Support serviceAccount attr for dataflow in the Apache beam
76dc7375b2 2022-04-25 Migrate Datastore system tests to new design (AIP-47)
0373fb0247 2022-04-25 'GoogleDriveToGCSOperator': Remove 'destination_bucket' and 'destination_object'
6b459995b2 2022-04-25 Add the format of Vertex Endpoint ID to the docstrings
27af0b7ebe 2022-04-25 Add the new parameter to the docstring
48abf571be 2022-04-25 Add 'endpoint_id' arg to 'google.cloud.operators.vertex_ai.CreateEndpointOperator'
8b6b0848a3 2022-04-23 Use new Breese for building, pulling and verifying the images. (#23104)
07a13bb708 2022-04-21 Change ComputeSSH to throw provider import error instead paramiko (#23035)
c36bcc4c06 2022-04-15 Upgrade to support Google Ads v10 (#22965)
ea1ae1963e 2022-04-14 Fix cancel_on_kill after execution timeout for DataprocSubmitJobOperator (#22955)
9a623e94cb 2022-04-13 migrate system test gcs_to_bigquery into new design (#22753)
aa317d92ea 2022-04-13 Fix select * query xcom push for BigQueryGetDataOperator (#22936)
27b3e31178 2022-04-11 implements #22859 - Add .sql as templatable extension (#22920)
03e1c9b152 2022-04-11 MSSQLToGCSOperator fails: datetime is not JSON Serializable (#22882)
6933022e94 2022-04-10 Fix new MyPy errors in main (#22884)
6aa65a38e0 2022-04-08 Add example DAG for demonstrating usage of GCS sensors (#22808)

6.8.0

Latest change: 2022-04-07

Commit Committed Subject
56ab82ed7a 2022-04-07 Prepare mid-April provider documentation. (#22819)
838cf401b9 2022-04-06 Fail ''LocalFilesystemToGCSOperator'' if src does not exist (#22772)
99b0211d50 2022-04-04 Modify transfer operators to handle more data (#22495)
f9e18472c0 2022-04-04 Add autodetect arg in BQCreateExternalTable Operator (#22710)
327eab3e26 2022-03-31 Add links for BigQuery Data Transfer (#22280)
02976bef88 2022-03-27 Refactor: BigQuery to GCS Operator (#22506)
719135ade0 2022-03-27 Remove references to deprecated operators/params in PubSub operators (#22519)
ca4b8d1744 2022-03-27 Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI service (#22088)
388723950d 2022-03-27 PostgresToGoogleCloudStorageOperator - BigQuery schema type for time zone naive fields (#22536)
c063fc688c 2022-03-25 Update black precommit (#22521)
3c7cd47319 2022-03-25 New design of system tests (#22311)
7ab45d41d6 2022-03-24 Update secrets backends to use get_conn_value instead of get_conn_uri (#22348)
d231e9b448 2022-03-24 Remove coerce_datetime usage from GCSTimeSpanFileTransformOperator (#22501)
82a26c0591 2022-03-24 Fix the docstrings (#22497)
38fde2ea79 2022-03-23 Fix 'download_media' url in 'GoogleDisplayVideo360SDFtoGCSOperator' (#22479)
0f0a1a7d22 2022-03-23 Fix to 'CloudBuildRunBuildTriggerOperator' fails to find build id. (#22419)

6.7.0

Latest change: 2022-03-22

Commit Committed Subject
d7dbfb7e26 2022-03-22 Add documentation for bugfix release of Providers (#22383)
7b851edc91 2022-03-21 Add 'LocalFilesystemToGoogleDriveOperator' (#22219)
14e6b657c2 2022-03-21 Add timeout and retry to the BigQueryInsertJobOperator (#22395)
a3ffbee7c9 2022-03-20 Fix skipping non-GCS located jars (#22302)
88402038ca 2022-03-19 Add dataflow_default_options to templated_fields (#22367)
6448b2458c 2022-03-15 [FIX] typo doc of gcs operator (#22290)

6.6.0

Latest change: 2022-03-14

Commit Committed Subject
16adc035b1 2022-03-14 Add documentation for Classifier release for March 2022 (#22226)
87c1246b79 2022-03-14 Add Dataplex operators (#20377)
c1ab8e2d7b 2022-03-14 Protect against accidental misuse of XCom.get_value() (#22244)
c108f264ab 2022-03-13 Change the default 'chunk_size' to a clear representation & add documentation (#22222)
45435399fe 2022-03-13 Support Uploading Bigger Files to Google Drive (#22179)
42a891d605 2022-03-13 Update ''GKEDeleteClusterOperator', ''GKECreateClusterOperator'' docstrings (#22212)
d08284ed25 2022-03-11 `` Add map_index to XCom model and interface (#22112)``
828d1cba4d 2022-03-10 Add support for ARM platform (#22127)
4ac771c316 2022-03-09 Fix spelling (#22107)
dd0724fdd2 2022-03-08 Add guide for DataprocInstantiateInlineWorkflowTemplateOperator (#22062)
dfd9805a23 2022-03-08 Use yaml safe load (#22091)
eba9703751 2022-03-08 Revert "Use yaml safe load (#22085)" (#22089)
7f4935bab3 2022-03-08 Use yaml safe load (#22085)
a11d831e3f 2022-03-07 Allow for uploading metadata with GCS Hook Upload (#22058)

6.5.0

Latest change: 2022-03-07

Commit Committed Subject
f5b96315fe 2022-03-07 Add documentation for Feb Providers release (#22056)
6db9b0029b 2022-03-07 Add Looker PDT operators (#20882)
9020b3a89d 2022-03-06 Add autodetect arg to external table creation in GCSToBigQueryOperator (#21944)
a0e2ebaa27 2022-03-02 Unpin 'google-cloud-memcache' (#21912)
84ed747db8 2022-03-02 Unpin ''pandas-gbq'' and remove unused code (#21915)
fb6b2d1fee 2022-03-01 Make project_id argument optional in all dataproc operators (#21866)
08575ddd8a 2022-03-01 Change BaseOperatorLink interface to take a ti_key, not a datetime (#21798)
6ca118dff1 2022-03-01 Allow templates in more DataprocUpdateClusterOperator fields (#21865)
0c55ca2cda 2022-02-28 Suppress hook warnings from the Bigquery transfers (#20119)
73eb24f25c 2022-02-24 Fix bigquery_dts parameter docstring typo (#21786)
3b4c26eb3a 2022-02-23 Add Dataproc assets/links (#21756)
6061cc4219 2022-02-20 Add Auto ML operators for Vertex AI service (#21470)
295efd36ea 2022-02-17 Dataflow Assets (#21639)
af2c047320 2022-02-16 Add GoogleCalendarToGCSOperator (#20769)
1b568d73e1 2022-02-15 Extract ClientInfo to module level (#21554)
dc03000de8 2022-02-15 Datafusion assets (#21518)
56365b102c 2022-02-15 Dataproc metastore assets (#21267)
6692e9191d 2022-02-15 Normalize *_conn_id parameters in BigQuery sensors (#21430)
2eb10565b2 2022-02-15 Fixed PostgresToGCSOperator fail on empty resultset for use_server_side_cursor=True (#21307)
da1e6578e0 2022-02-15 Fix multi query scenario in bigquery example DAG (#21575)

6.4.0

Latest change: 2022-02-14

Commit Committed Subject
28378d867a 2022-02-14 Add documentation for RC3 release of providers for Jan 2022 (#21553)
6bb0857df9 2022-02-13 (providers_google) add a location check in bigquery (#19571)
6579648af2 2022-02-13 Fix bigquery-hook when no engine_kwargs are passed
da485da29a 2022-02-13 Add support for BeamGoPipelineOperator (#20386)
05a883b35e 2022-02-11 Google Cloud Composer opearators (#21251)
833087f4f9 2022-02-10 Enable asynchronous job submission in BigQuery hook (#21385)
51aff276ca 2022-02-10 Optionally raise an error if source file does not exist in GCSToGCSOperator (#21391)
07fe9e8c6a 2022-02-09 Never set DagRun.state to State.NONE (#21263)
0a3ff43d41 2022-02-08 Add pre-commit check for docstring param types (#21398)
d94fa37830 2022-02-08 Fixed changelog for January 2022 (delayed) provider's release (#21439)
e973740208 2022-02-08 Create CustomJob and Datasets operators for Vertex AI service (#21253)
34d63fabc0 2022-02-08 Fix BigQueryDataTransferServiceHook.get_transfer_run() request parameter (#21293)
6b88d432d9 2022-02-06 Support to upload file to Google Shared Drive (#21319)
1a77bc6481 2022-02-06 :bug: (BigQueryHook) fix compatibility with sqlalchemy engine (#19508)
6c3a67d4fc 2022-02-05 Add documentation for January 2021 providers release (#21257)
39e395f981 2022-02-04 Add more SQL template fields renderers (#21237)
e840acf8d1 2022-02-04 Fix BigQuery system test (#21320)
ddb5246bd1 2022-02-03 Refactor operator links to not create ad hoc TaskInstances (#21285)
1d4b709e20 2022-01-28 Revert "Create CustomJob and Datasets operators for Vertex AI service (#20077)" (#21203)
48d44b885b 2022-01-28 Cloudsql import links fix. (#21199)
640c0b6763 2022-01-28 Create CustomJob and Datasets operators for Vertex AI service (#20077)
cb73053211 2022-01-27 Add optional features in providers. (#21074)
60aa518ebf 2022-01-26 batch as templated field in DataprocCreateBatchOperator (#20905)
623163f16a 2022-01-25 Extend dataproc example dag (#21091)
86ef016eab 2022-01-23 Make timeout Optional for wait_for_operation (#20981)
506efb6fa3 2022-01-21 Squelch more deprecation warnings (#21003)
372849486c 2022-01-21 Fix last google provider MyPy errors (#21010)
73c0d241d8 2022-01-21 Remove a few stray ':type's in docs (#21014)
602abe8394 2022-01-20 Remove ':type' lines now sphinx-autoapi supports typehints (#20951)
b8526abc2c 2022-01-19 Add encoding parameter to 'GCSToLocalFilesystemOperator' to fix #20901 (#20919)
58452f97db 2022-01-03 Add hook for integrating with Google Calendar (#20542)

6.3.0

Latest change: 2021-12-31

Commit Committed Subject
f77417eb0d 2021-12-31 Fix K8S changelog to be PyPI-compatible (#20614)
97496ba2b4 2021-12-31 Update documentation for provider December 2021 release (#20523)
a22d5bd076 2021-12-31 Fix mypy errors in Google Cloud provider (#20611)
4233ebe5ce 2021-12-31 Fix setting of project ID in ''provide_authorized_gcloud'' (#20428)
83f8e178ba 2021-12-31 Even more typing in operators (template_fields/ext) (#20608)
746ee587da 2021-12-31 Delete pods by default in KubernetesPodOperator (#20575)
41dbe2c4fc 2021-12-30 Fix mypy errors in google/cloud/operators/stackdriver (#20601)
dda688776c 2021-12-30 Fix Google mlengine MyPy errors (#20569)
d56e7b56bb 2021-12-30 Fix template_fields type to have MyPy friendly Sequence type (#20571)
bd9e8cef26 2021-12-30 Fix Google Mypy Dataproc errors (#20570)
a6e60ce25d 2021-12-30 Change download_video parameter to resourceName (#20528)
af4a2b0240 2021-12-30 Fix big query to mssql/mysql transfer issues (#20001)
a0821235fb 2021-12-30 Use typed Context EVERYWHERE (#20565)
da88ed1943 2021-12-29 Fix MyPy errors in Google Cloud (again) (#20469)
3a480f5ff4 2021-12-29 Fix passing the gzip compression parameter on sftp_to_gcs. (#20553)
bfd6d45cec 2021-12-29 switch to follow_redirects on httpx.get call in CloudSQL provider (#20239)
7d4d38b546 2021-12-29 avoid deprecation warnings in BigQuery transfer operators (#20502)
b7086f9815 2021-12-28 Use Python3.7+ syntax in pyupgrade (#20501)
a4622e19fa 2021-12-22 Support regional GKE cluster (#18966)
2ffdcf4b41 2021-12-21 Fixes docstring for PubSubCreateSubscriptionOperator (#20237)
d4c4f9e09e 2021-12-21 Fix mypy errors for google.cloud_build (#20234)
c6dbb3f885 2021-12-21 Fix MyPy for Google Bigquery (#20329)
ed604b62f3 2021-12-18 Fix remaining MyPy errors in Google Provider (#20358)
17404f1f10 2021-12-16 Move source_objects datatype check out of GCSToBigQueryOperator.__init__ (#20347)
174681911f 2021-12-16 Fix MyPy Errors for dataproc package (#20327)
2fb5e1d0ec 2021-12-15 Fix cached_property MyPy declaration and related MyPy errors (#20226)
21b8661886 2021-12-15 Fix missing get_backup method for Dataproc Metastore (#20326)
cdaa9a2529 2021-12-15 Fix MyPy errors for google.cloud.tasks (#20233)
43efde6230 2021-12-15 Fix MyPy Errors for Apache Beam (and Dataflow) provider. (#20301)
c4b3694101 2021-12-15 Fix MyPy errors in leveldb (#20222)
1570519a97 2021-12-14 Fix MyPy errors for google.cloud.transfers (#20229)
632bd0133e 2021-12-13 Fix MyPY errors for google.cloud.example_dags (#20232)
644051abcb 2021-12-13 Fix MyPy errors for google/marketing_platform and suite (#20227)
a208463802 2021-12-13 Organize S3 Classes in Amazon Provider (#20167)
98514cc159 2021-12-13 Add optional location to bigquery data transfer service (#15088) (#20221)
1f662571b2 2021-12-12 Fix MyPy errors in google.cloud.sensors (#20228)
22341b90da 2021-12-11 Add Google Cloud Tasks how-to documentation (#20145)
e9262752dc 2021-12-11 Finalised Datastore documentation (#20138)
fa96b09395 2021-12-09 Update Sphinx and Sphinx-AutoAPI (#20079)
ed8b63ba24 2021-12-08 Providers facebook hook multiple account (#19377)
50bf536656 2021-12-08 Remove deprecated method call (blob.download_as_string) (#20091)
564fe635bd 2021-12-06 Added example DAG for MSSQL to Google Cloud Storage (GCS) (#19873)
cb082d361a 2021-12-02 Remove deprecated template_fields from GoogleDriveToGCSOperator (#19991)
6977c47572 2021-12-01 BigQueryHook fix typo in run_load doc string (#19924)
f6dca1fa5e 2021-12-01 Update doc reference links (#19909)

6.2.0

Latest change: 2021-11-30

Commit Committed Subject
853576d901 2021-11-30 Update documentation for November 2021 provider's release (#19882)
fb478c00cd 2021-11-28 Move 'bucket_name' validation out of '__init__' in Google Marketing Platform operators (#19383)
e9e530979a 2021-11-28 Update 'default_args' value in example_functions DAG from str to int (#19865)
bf68b9a846 2021-11-26 Create dataproc serverless spark batches operator (#19248)
a192cecf6b 2021-11-26 updates pipeline_timeout CloudDataFusionStartPipelineOperator (#18773)
eb163c81d1 2021-11-25 Fix GCS system tests (#19227)
744d11bdb2 2021-11-25 Clean up ''default_args'' usage in docs (#19803)
0b2e1a8744 2021-11-22 Added wait mechanizm to the DataprocJobSensor to avoid 509 errors when Job is not available (#19740)
3336bb6c3c 2021-11-19 Fix badly merged impersonation in GKEPodOperator (#19696)
952ef908bc 2021-11-19 Support impersonation_chain parameter in the GKEStartPodOperator (#19518)
853c16465a 2021-11-18 Clean-up of google cloud example dags - batch 3 (#19664)
355dec8fea 2021-11-17 Misc. documentation typos and language improvements (#19599)
b9d31cd449 2021-11-17 Cleanup dynamic 'start_date' use for miscellaneous Google example DAGs (#19400)
daf234bd5e 2021-11-16 Remove reference to deprecated operator in example_dataproc (#19619)
48f228cf9e 2021-11-15 #16691 Providing more information in docs for DataprocCreateCluster operator migration (#19446)
6ef44b6a50 2021-11-15 Clean-up of google cloud example dags - batch 2 (#19527)
dc0159e7e4 2021-11-14 Add support in GCP connection for reading key from Secret Manager (#19164)
4212c49324 2021-11-14 Update Azure modules to comply with AIP-21 (#19431)
aa2cb5545f 2021-11-12 Remove remaining 'pylint: disable' comments (#19541)
c8dc0311da 2021-11-08 Fix Cloud SQL system tests (#19014)
26ad55beb0 2021-11-08 Add dataproc metastore operators (#18945)
9efb989d19 2021-11-07 Clean-up of google cloud example dags (#19436)
f421409b4d 2021-11-05 Fix typos in warnings, docstrings, exceptions (#19424)
a3c9956f79 2021-10-30 Add support of 'path' parameter for GCloud Storage Transfer Service operators (#17446)

6.1.0

Latest change: 2021-10-29

Commit Committed Subject
d9567eb106 2021-10-29 Prepare documentation for October Provider's release (#19321)
55abc2f620 2021-10-28 Support query timeout as an argument in CassandraToGCSOperator (#18927)
e4aa377da7 2021-10-28 Update BigQueryCreateExternalTableOperator doc and parameters (#18676)
20847fdbf8 2021-10-27 Add value to "namespaceId" of query (#19163)
3c08c025c5 2021-10-27 Move validation of templated input params to run after the context init (#19048)
eba1b68b30 2021-10-27 Update dataflow.py (#19231)
7ecf29f70d 2021-10-26 Fix hard-coded /tmp directory in CloudSQL Hook (#19229)
726a1517ec 2021-10-26 Fix bug in Dataflow hook when no jobs are returned (#18981)
d9192a55ba 2021-10-22 Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052)
4fae04a471 2021-10-21 Upgrade the Dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879)
0e95b57772 2021-10-19 Google provider catch invalid secret name (#18790)
86a2a19ad2 2021-10-17 More f-strings (#18855)
a418fd96f7 2021-10-17 Use google cloud credentials when executing beam command in subprocess (#18992)
5c3e453820 2021-10-15 Fix BigQueryToMsSqlOperator documentation (#18995)
406b38b2e3 2021-10-15 Replace default api_version of FacebookAdsReportToGcsOperator (#18996)
1571f80546 2021-10-14 Add pre-commit hook for common misspelling check in files (#18964)
20df60de24 2021-10-07 Dataflow Operators - use project and location from job in on_kill method. (#18699)
86bf2a29ba 2021-10-04 Simplify strings previously split across lines (#18679)

6.0.0

Latest change: 2021-09-30

Commit Committed Subject
840ea3efb9 2021-09-30 Update documentation for September providers release (#18613)
9279c44c91 2021-09-29 Fix part of Google system tests (#18494)
2fadf3c3cf 2021-09-27 Fix kubernetes engine system test (#18548)
a458fcc573 2021-09-27 Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)
97d6892318 2021-09-25 Rename AzureDataLakeStorage to ADLS (#18493)
a5439eee72 2021-09-23 Add index to the dataset name to have separate dataset for each example DAG (#18459)
18d7e1e227 2021-09-21 Fix BigQuery system test (#18373)
e25eea052f 2021-09-19 Inclusive Language (#18349)
7458f1e786 2021-09-18 Remove check for at least one schema in GCSToBigquery (#18150)
2474f8922d 2021-09-13 Migrate Google Cloud Build from Discovery API to Python SDK (#18184)
8ae2bb9bfa 2021-09-13 Fix error when create external table using table resource (#17998)
9140ad8d8f 2021-09-11 Use parameters instead of params (#18143)
3d4bfdcbb9 2021-09-10 Add missing __init__.py files for some test packages (#18142)
cfb602a33d 2021-09-10 Fix ''BigQuery'' data extraction in ''BigQueryToMySqlOperator'' (#18073)
2fd3f27ebd 2021-09-10 Make next_dagrun_info take a data interval (#18088)
944dcfbb91 2021-09-07 Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)
bfad233b91 2021-09-06 Fix providers tests in main branch with eager upgrades (#18040)
21348c194d 2021-09-03 fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)
9a0c10ba3f 2021-09-01 deduplicate running jobs on BigQueryInsertJobOperator (#17496)
fe34582fc2 2021-09-01 New google operator: SQLToGoogleSheetsOperator (#17887)
500780651c 2021-08-31 Add possibility to run DAGs from system tests and see DAGs logs (#17868)

5.1.0

Latest change: 2021-08-30

Commit Committed Subject
0a68588479 2021-08-30 Add August 2021 Provider's documentation (#17890)
b5da846dd1 2021-08-30 Fix missing Data Fusion sensor integration (#17914)
07405e6df4 2021-08-30 [AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787)
42e13e1a5a 2021-08-30 Remove all deprecation warnings in providers (#17900)
aa5952e58c 2021-08-27 Gcp ai hyperparameter tuning (#17790)
87769db98f 2021-08-27 Allow omission of 'initial_node_count' if 'node_pools' is specified (#17820)
be75dcd39c 2021-08-23 Update description about the new ''connection-types'' provider meta-data
d04aa13526 2021-08-20 [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137)
76ed2a49c6 2021-08-19 Import Hooks lazily individually in providers manager (#17682)
b68d1935f9 2021-08-19 Add error check for config_file parameter in GKEStartPodOperator (#17700)
29aab6434f 2021-08-17 Adds secrets backend/logging/auth information to provider yaml (#17625)
b06d528603 2021-08-11 Don't cache Google Secret Manager client (#17539)
67cbb0f181 2021-08-02 Enable specifying dictionary paths in 'template_fields_renderers' (#17321)
c384f9b0f5 2021-07-29 GCP Secret Manager error handling for missing credentials (#17264)

5.0.0

Latest change: 2021-07-26

Commit Committed Subject
87f408b1e7 2021-07-26 Prepares docs for Rc2 release of July providers (#17116)
448e50bd23 2021-07-26 Updating Google Cloud example DAGs to use XComArgs (#16875)
aaf44ccace 2021-07-26 Updating miscellaneous Google example DAGs to use XComArgs (#16876)
d01cc945dd 2021-07-26 Fixes several failing tests after broken main (#17222)
babc4250f3 2021-07-26 Fixes statich check failures (#17218)
5d2224795b 2021-07-25 Google Ads Hook: Support newer versions of the google-ads library (#17160)
966b250199 2021-07-25 Fix GCStoGCS operator with replace diabled and existing destination object (#16991)
763919d415 2021-07-25 Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)
81bd40933e 2021-07-23 [CASSANDRA-16814] Fix cassandra to gcs type inconsistency. (#17183)
026ffe65d4 2021-07-19 fix: dataprocpysparkjob project_id as self.project_id (#17075)
d02ded65ea 2021-07-15 Fixed wrongly escaped characters in amazon's changelog (#17020)
b916b75079 2021-07-15 Prepare documentation for July release of providers. (#17015)
a3f5c93806 2021-07-13 Update alias for field_mask in Google Memmcache (#16975)
b0f7f91fe2 2021-07-07 Standardise dataproc location param to region (#16034)
866a601b76 2021-06-28 Removes pylint from our toolchain (#16682)

4.0.0

Latest change: 2021-06-18

Commit Committed Subject
bbc627a3da 2021-06-18 Prepares documentation for rc2 release of Providers (#16501)
cbf8001d76 2021-06-16 Synchronizes updated changelog after buggfix release (#16464)
8a9c337838 2021-06-15 Remove class references in changelogs (#16454)
1fba5402bb 2021-06-15 More documentation update for June providers release (#16405)
3c5cc42e13 2021-06-14 Fix deprecation warnings location in google provider (#16403)
b272f9cec9 2021-06-13 fix: ensure datetime-related values fully compatible with MySQL and BigQuery (#15026)
7f8f75eb80 2021-06-12 Add BigQueryToMsSqlOperator (#15422)
0c80a7d411 2021-06-11 Fixes AzureFileShare connection extras (#16388)
9c94b72d44 2021-06-07 Updated documentation for June 2021 provider release (#16294)
1e647029e4 2021-06-01 Rename the main branch of the Airflow repo to be 'main' (#16149)
99d1535287 2021-05-31 Fix: GCS To BigQuery source_object (#16160)
e1137523d4 2021-05-30 Fix: Unnecessary downloads in ''GCSToLocalFilesystemOperator'' (#16171)
904709d34f 2021-05-27 Check synctatic correctness for code-snippets (#16005)
86768859c6 2021-05-26 Fix bigquery type error when export format is parquet (#16027)
6ae9aeec3f 2021-05-26 pass wait_for_done parameter down to _DataflowJobsController (#15541)
476d0f6e3d 2021-05-22 Bump pyupgrade v2.13.0 to v2.18.1 (#15991)
aa4713e43f 2021-05-21 Use api version only in GoogleAdsHook not operators (#15266)
76a80bb17c 2021-05-19 Move plyvel to google provider extra (#15812)
bb115da0b7 2021-05-17 Get rid of requests as core dependency (#15781)
9c8391a13f 2021-05-10 Fix spelling (#15699)
3711a29e5e 2021-05-09 Fix argument ordering and type of bucket and object (#15738)
a01567c471 2021-05-08 Fix sql_to_gcs docstring lint error (#15730)
f3fada9101 2021-05-07 Add short description to BaseSQLToGCSOperator docstring (#15728)
37681bca00 2021-05-07 Auto-apply apply_default decorator (#15667)
b8c0fde38a 2021-05-07 Add extra links for google dataproc (#10343)
3b4fdd0a7a 2021-05-06 add oracle connection link (#15632)
cf6324e43b 2021-05-04 Implement BigQuery Table Schema Update Operator (#15367)
0f97a3970d 2021-05-04 Rename example bucket names to use INVALID BUCKET NAME by default (#15651)

3.0.0

Latest change: 2021-05-01

Commit Committed Subject
807ad32ce5 2021-05-01 Prepares provider release after PIP 21 compatibility (#15576)
814e471d13 2021-04-29 Update pre-commit checks (#15583)
bf2b48174a 2021-04-27 Add Connection Documentation for Providers (#15499)
4b031d39e1 2021-04-27 Make Airflow code Pylint 2.8 compatible (#15534)
e229f3541d 2021-04-27 Use Pip 21.* to install airflow officially (#15513)
71c673e427 2021-04-22 Update Docstrings of Modules with Missing Params (#15391)
3b9a91806e 2021-04-22 Bugfix: Fix rendering of ''object_name'' in ''GCSToLocalFilesystemOperator'' (#15487)
c5e302030d 2021-04-21 Fix typo in DataprocCreateClusterOperator (#15462)
42a1ca8aab 2021-04-20 Fixes wrongly specified path for leveldb hook (#15453)
6da36bad2c 2021-04-18 [Airflow-15245] - passing custom image family name to the DataProcClusterCreateoperator (#15250)
f649905606 2021-04-15 fix docstring typos (#15392)
7bf69edca0 2021-04-08 Fix typo in a docstring (#15276)

2.2.0

Latest change: 2021-04-06

Commit Committed Subject
042be2e4e0 2021-04-06 Updated documentation for provider packages before April release (#15236)
eae22cec9c 2021-04-06 Adds 'Trino' provider (with lower memory footprint for tests) (#15187)
e49722859b 2021-04-05 Updates 3.6 limits for latest versions of a few libraries (#15209)
1d641d8f11 2021-04-01 update remaining old import paths of operators (#15127)
099c490cff 2021-03-28 Override project in dataprocSubmitJobOperator (#14981)
5379698892 2021-03-27 Improve docstrings for various modules (#15047)
a7ca1b3b0b 2021-03-26 Fix Sphinx Issues with Docstrings (#14968)
a7e144bec8 2021-03-23 Google Dataflow Hook to handle no Job Type (#14914)
72ea841b4b 2021-03-22 GCS to BigQuery Transfer Operator with Labels and Description parameter (#14881)
e172bd0e16 2021-03-22 Update docstrings to adhere to sphinx standards (#14918)
68e4c4dcb0 2021-03-20 Remove Backport Providers (#14886)
ddc9133d36 2021-03-15 Add GCS timespan transform operator (#13996)
943baff670 2021-03-10 Add job labels to bigquery check operators. (#14685)
6dc24c95e3 2021-03-07 Fix grammar and remove duplicate words (#14647)
e7bb17aeb8 2021-03-06 Use built-in 'cached_property' on Python 3.8 where possible (#14606)
7daebefd15 2021-03-05 Use libyaml C library when available. (#14577)
35c9a90292 2021-03-01 Add Google leveldb hook and operator (#13109) (#14105)

2.1.0

Latest change: 2021-02-27

Commit Committed Subject
589d6dec92 2021-02-27 Prepare to release the next wave of providers: (#14487)
50a1504c52 2021-02-27 Fix spellings (#14483)
bfef559cf6 2021-02-27 Corrects order of argument in docstring in GCSHook.download method (#14497)
33214d9326 2021-02-26 Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)
c281979982 2021-02-23 Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033)
ca35bd7f7f 2021-02-21 By default PIP will install all packages in .local folder (#14125)
a7e4266d67 2021-02-21 Refactor GoogleDriveToGCSOperator to use common methods (#14276)
1ab406663e 2021-02-16 Add GoogleDriveToLocalOperator (#14191)
59c94c679e 2021-02-13 Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)
e31b27d593 2021-02-13 Add materialized view support for BigQuery (#14201)
e3bcaa3ba3 2021-02-12 Correct typo in GCSObjectsWtihPrefixExistenceSensor (#14179)
7faa2d978c 2021-02-10 Add BigQueryUpdateTableOperator (#14149)
1da6972165 2021-02-10 Fixes to dataproc operators and hook (#14086)
02288cf2ba 2021-02-10 Add param to CloudDataTransferServiceOperator (#14118)
7d38645472 2021-02-09 #9803 fix bug in copy operation without wildcard (#13919)
b0c382426c 2021-02-07 Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982)
5d7d46bb33 2021-02-05 Improve GCSToSFTPOperator paths handling (#11284)
10343ec29f 2021-02-05 Corrections in docs and tools after releasing provider RCs (#14082)

2.0.0

Latest change: 2021-02-04

Commit Committed Subject
88bdcfa0df 2021-02-04 Prepare to release a new wave of providers. (#14013)
1872d8719d 2021-02-03 Add Apache Beam operators (#12814)
0e8c77b93a 2021-02-03 Support google-cloud-logging' >=2.0.0 (#13801)
833e338323 2021-02-02 Fix four bugs in StackdriverTaskHandler (#13784)
d2efb33239 2021-02-02 Support google-cloud-monitoring>=2.0.0 (#13769)
ac2f72c98d 2021-02-01 Implement provider versioning tools (#13767)
823741cfea 2021-01-28 Improve GCS system test envs (#13946)
6d6588fe2b 2021-01-28 Add Google Cloud Workflows Operators (#13366)
810c15ed85 2021-01-27 Fix and improve GCP BigTable hook and system test (#13896)
6616617331 2021-01-27 Add env variables to PubSub example dag (#13794)
f473ca7130 2021-01-24 Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)
a9ac2b040b 2021-01-23 Switch to f-strings using flynt. (#13732)
9592be88e5 2021-01-22 Fix Google Spanner example dag (#13842)
af52fdb511 2021-01-22 Improve environment variables in GCP Dataflow system test (#13841)
e7946f1cb7 2021-01-22 Improve environment variables in GCP Datafusion system test (#13837)
61c1d6ec6c 2021-01-22 Improve environment variables in GCP Memorystore system test (#13833)
202f66093a 2021-01-22 Improve environment variables in GCP Lifeciences system test (#13834)
70bf307f38 2021-01-21 Add How To Guide for Dataflow (#13461)
3fd5ef3555 2021-01-21 Add missing logos for integrations (#13717)
309788e5e2 2021-01-18 Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256)
7ec858c452 2021-01-17 updated Google DV360 Hook to fix SDF issue (#13703)
ef8617ec9d 2021-01-14 Support google-cloud-tasks>=2.0.0 (#13347)
189af54043 2021-01-13 Add system tests for Stackdriver operators (#13644)
a6f999b62e 2021-01-11 Support google-cloud-automl >=2.1.0 (#13505)
947dbb73bb 2021-01-11 Support google-cloud-datacatalog>=3.0.0 (#13534)
2fb68342b0 2021-01-07 Replace deprecated module and operator in example_tasks.py (#13527)
003584bbf1 2021-01-05 Fix failing backport packages test (#13497)
7d1ea4cb10 2021-01-05 Replace deprecated module and operator in example_tasks.py (#13473)
c7d75ad887 2021-01-05 Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482)
feb84057d3 2021-01-04 Support google-cloud-datacatalog 3.0.0 (#13224)
3a3e739981 2021-01-04 Fix insert_all method of BigQueryHook to support tables without schema (#13138)
c33d2c06b6 2021-01-02 Fix another pylint c-extension-no-member (#13438)
f6518dd6a1 2021-01-02 Generalize MLEngineStartTrainingJobOperator to custom images (#13318)
9de7127083 2020-12-31 Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337)
406181d64a 2020-12-31 Add Parquet data type to BaseSQLToGCSOperator (#13359)
295d66f914 2020-12-30 Fix Grammar in PIP warning (#13380)
13a9747bf1 2020-12-28 Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341)
04ec45f045 2020-12-28 Add DataprocCreateWorkflowTemplateOperator (#13338)
1f712219fa 2020-12-28 Support google-cloud-tasks>=2.0.0 (#13334)
f4745c8ce1 2020-12-26 Fix typo in example (#13321)
e9d65bd458 2020-12-24 Decode Remote Google Logs (#13115)
e7aeacf335 2020-12-24 Add OracleToGCS Transfer (#13246)
323084e97d 2020-12-24 Add timeout option to gcs hook methods. (#13156)
0b626c8042 2020-12-22 Support google-cloud-redis>=2.0.0 (#13117)
9042a58553 2020-12-22 Add more operators to example DAGs for Cloud Tasks (#13235)
8c00ec89b9 2020-12-22 Support google-cloud-pubsub>=2.0.0 (#13127)
b26b0df5b0 2020-12-22 Update compatibility with google-cloud-kms>=2.0 (#13124)
9a1d3820d6 2020-12-22 Support google-cloud-datacatalog>=1.0.0 (#13097)
f95b1c9c95 2020-12-21 Add regional support to dataproc workflow template operators (#12907)
6cf76d7ac0 2020-12-18 Fix typo in pip upgrade command :( (#13148)
23f27c1b1c 2020-12-18 Add system tests for CloudKMSHook (#13122)
cddbf81b12 2020-12-17 Fix Google BigQueryHook method get_schema() (#13136)
1259c712a4 2020-12-17 Update compatibility with google-cloud-os-login>=2.0.0 (#13126)
bcf77586ef 2020-12-16 Fix Data Catalog operators (#13096)
5090fb0c89 2020-12-15 Add script to generate integrations.json (#13073)
b4b9cf5597 2020-12-14 Check for missing references to operator guides (#13059)
1c1ef7ee69 2020-12-14 Add project_id to client inside BigQuery hook update_table method (#13018)

1.0.0

Latest change: 2020-12-09

Commit Committed Subject
32971a1a2d 2020-12-09 Updates providers versions to 1.0.0 (#12955)
b40dffa085 2020-12-08 Rename remaing modules to match AIP-21 (#12917)
9b39f24780 2020-12-08 Add support for dynamic connection form fields per provider (#12558)
1dcd3e13fd 2020-12-05 Add support for extra links coming from the providers (#12472)
2037303eef 2020-11-29 Adds support for Connection/Hook discovery from providers (#12466)
02d94349be 2020-11-29 Don't use time.time() or timezone.utcnow() for duration calculations (#12353)
76bcd08dca 2020-11-28 Added '@apply_defaults' decorator. (#12620)
e1ebfa68b1 2020-11-27 Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249)
3fa51f94d7 2020-11-24 Add check for duplicates in provider.yaml files (#12578)
c34ef853c8 2020-11-20 Separate out documentation building per provider (#12444)
9e3b2c554d 2020-11-19 GCP Secrets Optional Lookup (#12360)
0080354502 2020-11-18 Update provider READMEs for 1.0.0b2 batch release (#12449)
7ca0b6f121 2020-11-18 Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)
8d09506464 2020-11-18 Fix download method in GCSToBigQueryOperator (#12442)
2c0920fba5 2020-11-17 Adds mechanism for provider package discovery. (#12383)
2cda2f2a0a 2020-11-17 Add missing pre-commit definition - provider-yamls (#12393)
80a957f142 2020-11-17 Add Dataflow sensors - job metrics (#12039)
ae7cb4a1e2 2020-11-17 Update wrong commit hash in backport provider changes (#12390)
917e6c4424 2020-11-16 Add provide_file_and_upload to GCSHook (#12310)
cfa4ecfeb0 2020-11-15 Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726)
6889a333cf 2020-11-15 Improvements for operators and hooks ref docs (#12366)
7825e8f590 2020-11-13 Docs installation improvements (#12304)
32b59f8350 2020-11-12 Fixes the sending of an empty list to BigQuery 'list_rows' (#12307)
250436d962 2020-11-10 Fix spelling in Python files (#12230)
502ba309ea 2020-11-10 Enable Markdownlint rule - MD022/blanks-around-headings (#12225)
dd2095f4a8 2020-11-10 Simplify string expressions & Use f-string (#12216)
f37c6e6fce 2020-11-10 Add Compute Engine SSH hook (#9879)
85a18e13d9 2020-11-09 Point at pypi project pages for cross-dependency of provider packages (#12212)
59eb5de78c 2020-11-09 Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)
61feb6ec45 2020-11-09 Provider's readmes generated for elasticsearch and google packages (#12194)
b2a28d1590 2020-11-09 Moves provider packages scripts to dev (#12082)
fcb6b00efe 2020-11-08 Add authentication to AWS with Google credentials (#12079)
2ef3b7ef8c 2020-11-08 Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172)
0caec9fd32 2020-11-06 Dataflow - add waiting for successful job cancel (#11501)
cf9437d79f 2020-11-06 Simplify string expressions (#12123)
91a64db505 2020-11-04 Format all files (without excepions) by black (#12091)
fd3db778e7 2020-11-04 Add server side cursor support for postgres to GCS operator (#11793)
f1f1940261 2020-11-04 Add DataflowStartSQLQuery operator (#8553)
41bf172c1d 2020-11-04 Simplify string expressions (#12093)
5f5244b74d 2020-11-04 Add template fields renderers to Biguery and Dataproc operators (#12067)
4e8f9cc8d0 2020-11-03 Enable Black - Python Auto Formmatter (#9550)
8c42cf1b00 2020-11-03 Use PyUpgrade to use Python 3.6 features (#11447)
45ae145c25 2020-11-03 Log BigQuery job id in insert method of BigQueryHook (#12056)
e324b37a67 2020-11-03 Add job name and progress logs to Cloud Storage Transfer Hook (#12014)
6071fdd584 2020-11-02 Improve handling server errors in DataprocSubmitJobOperator (#11947)
2f703df12d 2020-10-30 Add SalesforceToGcsOperator (#10760)
e5713e00b3 2020-10-29 Add drain option when canceling Dataflow pipelines (#11374)
37eaac3c5d 2020-10-29 The PRs which are not approved run subset of tests (#11828)
79cb771992 2020-10-28 Fixing re pattern and changing to use a single character class. (#11857)
5a439e84eb 2020-10-26 Prepare providers release 0.0.2a1 (#11855)
240c7d4d72 2020-10-26 Google Memcached hooks - improve protobuf messages handling (#11743)
8afdb6ac6a 2020-10-26 Fix spellings (#11825)
872b1566a1 2020-10-25 Generated backport providers readmes/setup for 2020.10.29 (#11826)
6ce855af11 2020-10-24 Fix spelling (#11821)
4830687453 2020-10-24 Use Python 3 style super classes (#11806)
727c739afb 2020-10-22 Improve Cloud Memorystore for Redis example (#11735)
1da8379c91 2020-10-22 Fix static checks after merging #10121 (#11737)
91503308c7 2020-10-22 Add Google Cloud Memorystore Memcached Operators (#10121)
950c16d0b0 2020-10-21 Retry requests in case of error in Google ML Engine Hook (#11712)
2bfc53b5eb 2020-10-21 Fix doc errors in google provider files. (#11713)
53e6062105 2020-10-21 Enforce strict rules for yamllint (#11709)
349b0811c3 2020-10-20 Add D200 pydocstyle check (#11688)
2d854c3505 2020-10-19 Add service_account to Google ML Engine operator (#11619)
46a121fb7b 2020-10-18 docs: Update Bigquery clustering docstrings (#11232)
49c58147fe 2020-10-18 Strict type checking for provider Google (#11609)
0823d46a7f 2020-10-16 Add type annotations for AWS operators and hooks (#11434)
3c10ca6504 2020-10-16 Add DataflowStartFlexTemplateOperator (#8550)
8865d14df4 2020-10-16 Strict type checking for provider google cloud (#11548)
16e7129719 2020-10-13 Added support for provider packages for Airflow 2.0 (#11487)
06141d6d01 2020-10-12 Google cloud operator strict type check (#11450)
d305876bee 2020-10-12 Remove redundant None provided as default to dict.get() (#11448)
1845cd11b7 2020-10-11 Strict type check for google ads and cloud hooks (#11390)
bd204bb91b 2020-10-11 Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409)
75071831ba 2020-10-10 Remove redundant parentheses from Python files (#10967)
8baf657fc2 2020-10-09 Fix regression in DataflowTemplatedJobStartOperator (#11167)
b0fcf67559 2020-10-07 Add AzureFileShareToGCSOperator (#10991)
47b05a87f0 2020-10-07 Improve handling of job_id in BigQuery operators (#11287)
0a0e1af800 2020-10-03 Fix Broken Markdown links in Providers README TOC (#11249)
ca4238eb4d 2020-10-02 Fixed month in backport packages to October (#11242)
5220e4c384 2020-10-02 Prepare Backport release 2020.09.07 (#11238)
cb52fb0ae1 2020-09-27 Add example DAG and system test for MySQLToGCSOperator (#10990)
99accec29d 2020-09-25 Fix incorrect Usage of Optional[str] & Optional[int] (#11141)
e3f96ce7a8 2020-09-24 Fix incorrect Usage of Optional[bool] (#11138)
daf8f31080 2020-09-23 Add template fields renderers for better UI rendering (#11061)
f3e87c5030 2020-09-22 Add D202 pydocstyle check (#11032)
cb979f9f21 2020-09-22 Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024)
76545bb3d6 2020-09-16 Add example dag and system test for S3ToGCSOperator (#10951)
22c631625f 2020-09-16 Fix more docs spellings (#10965)
12a652f534 2020-09-13 Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)
41a62735ed 2020-09-11 Add on_kill method to BigQueryInsertJobOperator (#10866)
3e91da56e8 2020-09-11 fix typo in firebase/example_filestore DAG (#10875)
68cc7273bf 2020-09-10 Add on_kill method to DataprocSubmitJobOperator (#10847)
f920957214 2020-09-10 Fix and remove some more typos from spelling_wordlist.txt (#10845)
9549274d11 2020-09-09 Upgrade black to 20.8b1 (#10818)
078bfaf60a 2020-09-08 Extract missing gcs_to_local example DAG from gcs example (#10767)
10ce31127f 2020-09-08 Deprecate using global as the default region in Google Dataproc operators and hooks (#10772)
f14f379716 2020-09-07 [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773)
c8ee455685 2020-09-07 Refactor DataprocCreateCluster operator to use simpler interface (#10403)
ece685b5b8 2020-09-05 Asynchronous execution of Dataproc jobs with a Sensor (#10673)
6e3d7b63d3 2020-09-04 Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578)
804548d58f 2020-09-01 Add Dataprep operators (#10304)
11c00bc820 2020-08-30 Fix typos: duplicated "the" (#10647)
2ca615cffe 2020-08-29 Update Google Cloud branding (#10642)
1b533f617e 2020-08-28 Fix broken master - DLP (#10635)
5ae82a56da 2020-08-28 Fix Google DLP example and improve ops idempotency (#10608)
3867f76625 2020-08-28 Update Google Cloud branding (#10615)
91ff31ad10 2020-08-27 Documentation for Google Cloud Data Loss Prevention (#8201) (#9651)
fdd9b6f65b 2020-08-25 Enable Black on Providers Packages (#10543)
d760265452 2020-08-25 PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)
d1bce91bb2 2020-08-25 PyDocStyle: Enable D403: Capitalized first word of docstring (#10530)
866701c801 2020-08-25 Fix typo in "Cloud" (#10534)
47265e7b58 2020-08-24 Fix typo in PostgresHook (#10529)
3696c34c28 2020-08-24 Fix typo in the word "release" (#10528)
2f2d8dbfaf 2020-08-25 Remove all "noinspection" comments native to IntelliJ (#10525)
3734876d98 2020-08-24 Implement impersonation in google operators (#10052)
b0598b5351 2020-08-24 Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475)
ee7ca128a1 2020-08-22 Fix broken Markdown refernces in Providers README (#10483)
515cc72c99 2020-08-22 Fix typo in timed_out (#10459)
7c206a82a6 2020-08-22 Replace assigment with Augmented assignment (#10468)
88c7d2e526 2020-08-21 Dataflow operators don't not always create a virtualenv (#10373)
083c3c129b 2020-08-18 Simplified GCSTaskHandler configuration (#10365)
1ae5bdf23e 2020-08-17 Add test for GCSTaskHandler (#9600) (#9861)
e195a980bc 2020-08-16 Add type annotations for mlengine_operator_utils (#10297)
382c1011b6 2020-08-16 Add Bigtable Update Instance Hook/Operator (#10340)
bfa5a8d5f1 2020-08-15 CI: Fix failing docs-build (#10342)
be46d20fb4 2020-08-15 Improve idempotency of BigQueryInsertJobOperator (#9590)
47387a69e6 2020-08-14 Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326)
2f0613b0c2 2020-08-13 Implement Google BigQuery Table Partition Sensor (#10218)
f6734b3b85 2020-08-12 Enable Sphinx spellcheck for doc generation (#10280)
8f8db8959e 2020-08-12 DbApiHook: Support kwargs in get_pandas_df (#9730)
ef088314f8 2020-08-09 Added DataprepGetJobsForJobGroupOperator (#10246)
b43f90abf4 2020-08-09 Fix various typos in the repo (#10263)
c29533888f 2020-08-08 Add labels param to Google MLEngine Operators (#10222)
cdec301254 2020-08-07 Add correct signature to all operators and sensors (#10205)
eff0f03210 2020-08-06 `` Update guide for Google Cloud Secret Manager Backend (#10172)``
24c8e4c2d6 2020-08-06 Changes to all the constructors to remove the args argument (#10163)
010322692e 2020-08-06 Improve handling Dataproc cluster creation with ERROR state (#9593)
1437cb7495 2020-08-04 Add correct signatures for operators in google provider package (#10144)
6efa1b9cb7 2020-08-03 Add additional Cloud Datastore operators (#10032)
27020f8e58 2020-08-03 Add try clause to DataFusionHook.wait_for_pipeline_state (#10031)
4e3799fec4 2020-08-02 [AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117)
85c56b1737 2020-08-02 Add missing params to GCP Pub/Sub creation_subscription (#10106)
b79466c12f 2020-08-02 Fix sensor not providing arguments for GCSHook (#10074)
4ee35d0279 2020-08-02 Fix hook not passing gcp_conn_id to base class (#10075)
aeea71274d 2020-08-02 Remove 'args' parameter from provider operator constructors (#10097)
4c84661adb 2020-07-31 Split Display Video 360 example into smaler DAGs (#10077)
59cbff0874 2020-07-29 Fix docstrings in BigQueryGetDataOperator (#10042)
81b87d48ed 2020-07-27 Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996)
7d24b088cd 2020-07-25 Stop using start_date in default_args in example_dags (2) (#9985)
8b10a4b35e 2020-07-25 Stop using start_date in default_args in example_dags (#9982)
ef98edf4da 2020-07-23 Add more information about using GoogleAdsHook (#9951)
33f0cd2657 2020-07-22 apply_default keeps the function signature for mypy (#9784)
39a0288a47 2020-07-22 Add Google Authentication for experimental API (#9848)
c2db0dfeb1 2020-07-22 More strict rules in mypy (#9705) (#9906)
c4244e18bb 2020-07-22 Fix calling 'get_client' in BigQueryHook.table_exists (#9916)
5eacc16420 2020-07-22 Add support for impersonation in GCP hooks (#9915)
1cfdebf5f8 2020-07-21 Fix insert_job method of BigQueryHook (#9899)
c8c52e69c8 2020-07-21 Remove type hint causing DeprecationWarning in Firestore operators (#9819)
eb6f1d1cf0 2020-07-16 Fix typo in datafusion operator (#9859)
b01d95ec22 2020-07-15 Change DAG.clear to take dag_run_state (#9824)
6d65c15d15 2020-07-15 Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798)
770de53eb5 2020-07-15 BigQueryTableExistenceSensor needs to specify keyword arguments (#9832)
2d8dbacdf6 2020-07-15 Add CloudVisionDeleteReferenceImageOperator (#9698)
9f017951b9 2020-07-15 Add Google Deployment Manager Hook (#9159)
ed5004cca7 2020-07-14 Allow 'replace' flag in gcs_to_gcs operator. (#9667)
553bb7af7c 2020-07-13 Keep functions signatures in decorators (#9786)
68925904e4 2020-07-13 Add multiple file upload functionality to GCS hook (#8849)
1de78e8f97 2020-07-12 Add Google Stackdriver link (#9765)
092d33f298 2020-07-11 Fix StackdriverTaskHandler + add system tests (#9761)
b2305660f0 2020-07-09 Update example DAG for AI Platform operators (#9727)
23f80f34ad 2020-07-08 Move gcs & wasb task handlers to their respective provider packages (#9714)
44d4ae809c 2020-07-06 Upgrade to latest pre-commit checks (#9686)
a79e2d4c4a 2020-07-06 Move provider's log task handlers to the provider package (#9604)
cd3d9d9340 2020-07-02 Fix using .json template extension in GMP operators (#9566)
4799af30ee 2020-06-30 Extend BigQuery example with include clause (#9572)
e33f1a12d7 2020-06-30 Add template_ext to BigQueryInsertJobOperator (#9568)
40add26d45 2020-06-29 Remove almost all references to airflow.contrib (#9559)
c420dbd6e1 2020-06-27 Bump Pylint to 2.5.3 (#9294)
0051c89cba 2020-06-26 nitpick fix (#9527)
87fdbd0708 2020-06-25 Use literal syntax instead of function calls to create data structure (#9516)
7256f4caa2 2020-06-22 Pylint fixes and deprecation of rare used methods in Connection (#9419)
e13a14c873 2020-06-21 Enable & Fix Whitespace related PyDocStyle Checks (#9458)
5b680e27e8 2020-06-19 Don't use connection to store task handler credentials (#9381)
d0e7db4024 2020-06-19 Fixed release number for fresh release (#9408)
416334e2ec 2020-06-19 Properly propagated warnings in operators (#9348)
12af6a0800 2020-06-19 Final cleanup for 2020.6.23rc1 release preparation (#9404)
c7e5bce57f 2020-06-19 Prepare backport release candidate for 2020.6.23rc1 (#9370)
4e09c64423 2020-06-18 Adds GCP Secret Manager Hook (#9368)
40bf8f28f9 2020-06-18 Detect automatically the lack of reference to the guide in the operator descriptions (#9290)
f6bd817a3a 2020-06-16 Introduce 'transfers' packages (#9320)
639972d995 2020-06-16 Add support for latest Apache Beam SDK in Dataflow operators (#9323)
1459970b3b 2020-06-15 Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)
431ea3291c 2020-06-15 Resolve upstream tasks when template field is XComArg (#8805)
aee6ab94eb 2020-06-15 Wait for pipeline state in Data Fusion operators (#8954)
fb1c8b83d4 2020-06-10 Add test for BQ operations using location (#9206)
a26afbfa51 2020-06-10 Make generated job_id more informative in BQ insert_job (#9203)
c41192fa1f 2020-06-10 Upgrade pendulum to latest major version ~2.0 (#9184)
b1c8c5ed5b 2020-06-09 Allows using private endpoints in GKEStartPodOperator (#9169)
5918efc86a 2020-06-05 Add 3.8 to the test matrices (#8836)
9bcdadaf7e 2020-06-05 Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)
f56811dff3 2020-06-05 [AIRFLOW-6290] Create guide for GKE operators (#8883)
76962867b5 2020-06-04 Fix sql_to_gcs hook gzip of schema_file (#9140)
17adcea835 2020-06-02 Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)
7898525468 2020-06-01 Add BigQueryInsertJobOperator (#8868)
29eb68b90b 2020-05-31 Create guide for Dataproc Operators (#9037)
886afaf622 2020-05-29 Add example dag and system test for LocalFilesystemToGCSOperator (#9043)
a779c4dfc2 2020-05-29 add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)
ada26be23c 2020-05-29 Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)
81b2761b86 2020-05-29 add example dag and system test for GoogleSheetsToGCSOperator (#9056)
0b0e4f7a4c 2020-05-26 Preparing for RC3 relase of backports (#9026)
00642a46d0 2020-05-26 Fixed name of 20 remaining wrongly named operators. (#8994)
3994030ea6 2020-05-26 Refactor BigQuery operators (#8858)
cdb3f25456 2020-05-26 All classes in backport providers are now importable in Airflow 1.10 (#8991)
1d36b0303b 2020-05-23 Fix references in docs (#8984)
cf5cf45e1c 2020-05-23 Support YAML input for CloudBuildCreateOperator (#8808)
499493c5c5 2020-05-19 [AIRFLOW-6586] Improvements to gcs sensor (#7197)
375d1ca229 2020-05-19 Release candidate 2 for backport packages 2020.05.20 (#8898)
841d816647 2020-05-19 Allow setting the pooling time in DLPHook (#8824)
12c5e5d8ae 2020-05-17 Prepare release candidate for backport packages (#8891)
f3521fb0e3 2020-05-16 Regenerate readme files for backport package release (#8886)
15273f0ea0 2020-05-16 Check for same task instead of Equality to detect Duplicate Tasks (#8828)
92585ca4cb 2020-05-15 Added automated release notes generation for backport operators (#8807)
e1e833bb26 2020-05-13 Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)
8b54919711 2020-05-12 Refactor BigQuery hook methods to use python library (#8631)
6911dfe837 2020-05-12 Fix template fields in Google operators (#8840)
4b06fde0f1 2020-05-12 Fix Flake8 errors (#8841)
1d12c347cb 2020-05-12 Refactor BigQuery check operators (#8813)
493b685d78 2020-05-10 Add separate example DAGs and system tests for google cloud speech (#8778)
79ef8bed89 2020-05-10 Added Upload Multiple Entity Read Files to specified big query dataset (#8610)
280f1f0c4c 2020-05-10 Correctly restore upstream_task_ids when deserializing Operators (#8775)
58aefb23b1 2020-05-08 Added SDFtoGCSOperator (#8740)
723c52c942 2020-05-07 Add documentation for SpannerDeployInstanceOperator (#8750)
25ee4211b3 2020-05-06 Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)
8d6f1aa4b5 2020-05-05 Support num_retries field in env var for GCP connection (#8700)
67caae0f25 2020-05-04 Add system test for gcs_to_bigquery (#8556)
bc45fa6759 2020-05-03 Add system test and docs for Facebook Ads operators (#8503)
a28c66f23d 2020-04-30 [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)
992a24ce41 2020-04-28 Split and improve BigQuery example DAG (#8529)
c1fb28230f 2020-04-28 Refactor BigQueryHook dataset operations (#8477)
e8d0f8feab 2020-04-26 Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)
37fdfa9775 2020-04-26 [AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)
14b22e6ffe 2020-04-25 Add hook and operator for Google Cloud Life Sciences (#8481)
72ddc94d1e 2020-04-23 Pass location using parmamter in Dataflow integration (#8382)
912aa4b423 2020-04-23 Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)
57c8c05839 2020-04-22 Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)
5d3a7eef30 2020-04-20 Allow multiple extra_packages in Dataflow (#8394)
79c99b1b6a 2020-04-18 Added location parameter to BigQueryCheckOperator (#8273)
79d3f33c1b 2020-04-17 Clean up temporary files in Dataflow operators (#8313)
efcffa323d 2020-04-16 Add Dataproc SparkR Example (#8240)
b198a1fa94 2020-04-15 Create guide for BigQuery operators (#8276)
2636cc932c 2020-04-14 Raise exception when GCP credential doesn't support account impersonation (#8213)
eee4ebaeeb 2020-04-14 Added Facebook Ads Operator #7887 (#8008)
8cae07ea18 2020-04-14 fixed typo (#8294)
45c8983306 2020-04-13 Less aggressive eager upgrade of requirements (#8267)
1fd9ed3840 2020-04-13 Add mypy plugin for decorators. (#8145)
327b0a9f77 2020-04-13 Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)
bb5e403a32 2020-04-10 Honor schema type for MySQL to GCS data pre-process (#8090)
87969a350d 2020-04-09 [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)
3fc89f29f5 2020-04-06 [AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)
7ef75d2393 2020-04-03 [AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)
ed2bc00576 2020-04-02 Add Google Ads list accounts operator (#8007)
3808a6206e 2020-04-01 Unify Google class/package names (#8033)
8a02402576 2020-03-31 Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)
8e89780071 2020-03-31 Add more refactor steps for providers.google (#8010)
aae3b8fb27 2020-03-31 Individual package READMEs (#8012)
779023968f 2020-03-30 [AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)
49abce5217 2020-03-30 Improve system tests for Cloud Build (#8003)
0f19a930d1 2020-03-29 Remove GKEStartPodOperator when backporting (#7908)
0e1c238b2f 2020-03-28 Get Airflow Variables from GCP Secrets Manager (#7946)
eb4af4f944 2020-03-28 Make BaseSecretsBackend.build_path generic (#7948)
01f99426fd 2020-03-28 Add download/upload operators for GCS and Google Sheets (#7866)
892522f8e2 2020-03-26 Change signature of GSheetsHook methods (#7853)
bfd425157a 2020-03-26 Improve idempotency in MLEngineHook.create_model (#7811)
f9c226343d 2020-03-26 Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)
e3920f12f4 2020-03-26 Improve setUp/tearDown in Cloud Firestore system test (#7862)
8ba8a7295a 2020-03-26 Improve example DAGs for Cloud Memorystore (#7855)
f7d1a437c1 2020-03-26 Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)
beef6c230e 2020-03-26 Improve authorization in GCP system tests (#7863)
5f165f3e42 2020-03-26 [AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)
686d7d50bd 2020-03-25 Standardize SecretBackend class names (#7846)
1982c3fdca 2020-03-24 Run Dataflow for ML Engine summary in venv (#7809)
eef87b9953 2020-03-23 [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)
529db07b2e 2020-03-23 Improve Google PubSub hook publish method (#7831)
4bde99f132 2020-03-23 Make airflow/providers pylint compatible (#7802)
a001489b59 2020-03-23 Improve example DAG for ML Engine (#7810)
9e5a8e7f83 2020-03-23 Add call to Super class in 'google' providers (#7823)
b86bf79bff 2020-03-23 Fix typo in GCP credentials_provider's docstring (#7818)
56c013ce92 2020-03-23 Add missing docstring in BigQueryHook.create_empty_table (#7817)
426a79847c 2020-03-23 Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812)
cdf1809fce 2020-03-23 [AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)
27dac00e12 2020-03-22 [AIRFLOW-7099] Improve system test for cloud transfer service (#7794)
0daf5d729a 2020-03-22 Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)
c8088c2bd7 2020-03-20 [AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)
5106a29314 2020-03-20 [AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)
759ce2a80c 2020-03-20 [AIRFLOW-6978] Add PubSubPullOperator (#7766)
6b9b214e4c 2020-03-20 [AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)
b118916969 2020-03-19 [AIRFLOW-7069] Fix cloudsql system tests (#7770)
ae854cae5a 2020-03-19 [AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)
7e1e954d23 2020-03-19 [AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)
6e21c139b3 2020-03-19 [AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)
ce022a3f72 2020-03-19 [AIRFLOW-XXXX] Add cross-references for operators guide (#7760)
029c84e552 2020-03-18 [AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)
63a3102ede 2020-03-18 [AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)
73305c7bd5 2020-03-18 [AIRFLOW-7081] Remove env variables from GCP guide (#7755)
60fdbf6d92 2020-03-18 [AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)
de7e934ca3 2020-03-17 [AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)
0de0347b27 2020-03-17 [AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475)
91557c6f87 2020-03-17 [AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)
51161dbd9d 2020-03-16 [AIRFLOW-5664] Store timestamps with microseconds precision (#6354)
2bc020c431 2020-03-14 [AIRFLOW-7055] Verbose logging option for google provider (#7711)
c997cab42d 2020-03-13 [AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)
137896f326 2020-03-12 [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)
1f77f943d5 2020-03-10 [AIRFLOW-6980] Improve system tests and building providers package (#7615)
bf9b6b6d70 2020-03-09 [AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)
e5130dc9fe 2020-03-09 [AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)
faf0df4b94 2020-03-09 [AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)
42eef38217 2020-03-07 [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)
b5b9795f04 2020-03-07 [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)
6b65038fb4 2020-03-06 [AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)
755fe52249 2020-03-05 [AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)
cb2f339116 2020-03-04 [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)
09fea3ce8e 2020-03-04 [AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)
8230ccc48b 2020-03-04 [AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)
0d1e3088aa 2020-03-04 [AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)
ab6bb0012c 2020-03-03 [AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)
3db4ade3dc 2020-02-29 [AIRFLOW-6924] Fix Google DLP operators return types (#7546)
008b4bab14 2020-02-27 [AIRFLOW-6730] Use total_seconds instead of seconds (#7363)
bb552b2d9f 2020-02-25 [AIRFLOW-6908] Lazy load AirflowException (#7528)
d1a34246ac 2020-02-25 [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)
3320e432a1 2020-02-24 [AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)
dcf8743521 2020-02-24 [AIRFLOW-6894] Prevent db query in example_dags (#7516)
4d03e33c11 2020-02-22 [AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)
35b9616378 2020-02-21 [AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)
aff3a361b4 2020-02-20 [AIRFLOW-6558] Campaign Manager operators for conversions (#7420)
9cbd7de6d1 2020-02-18 [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)
5b199cb86b 2020-02-17 [AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)
2c9345a8e0 2020-02-17 [AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)
946bdc23c0 2020-02-16 [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)
2381c820c8 2020-02-13 [AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)
04c1fefbf2 2020-02-03 [AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)
a0252748ff 2020-02-03 [AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)
97a429f9d0 2020-02-02 [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)
9d8d075578 2020-02-03 [AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)
cf141506a2 2020-02-02 [AIRFLOW-6708] Set unique logger names (#7330)
373c6aa4a2 2020-01-30 [AIRFLOW-6682] Move GCP classes to providers package (#7295)
83c037873f 2020-01-30 [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)
057f3ae3a4 2020-01-29 [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)
ceea293c16 2020-01-28 [AIRFLOW-6656] Fix AIP-21 moving (#7272)
c42a375e79 2020-01-27 [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)
059eda05f8 2020-01-21 [AIRFLOW-6610] Move software classes to providers package (#7231)
f4d3e5e545 2020-01-13 [AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)
e7bf8ecb48 2020-01-13 [AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)
5b6772cb83 2020-01-09 [AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)
4f8592ae8f 2020-01-08 [AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)
20299473f1 2020-01-03 [AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)
18e8cea4e7 2020-01-03 [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)
95087af140 2019-12-31 [AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)
69629a5a94 2019-12-09 [AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)
25e9047a4a 2019-12-09 [AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)
ed0a14f321 2019-12-09 [AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)
2f2f89c148 2019-12-01 [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)
03c870a617 2019-11-26 [AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)
5c4cfea8c0 2019-11-15 [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)
44a8c37a9a 2019-11-13 [AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)
d633d3ac44 2019-11-13 [AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)
d985c02d9f 2019-11-05 [AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)
a296cdabdb 2019-11-04 [AIRFLOW-5743] Move Google PubSub to providers package (#6476)
470b2a779d 2019-10-30 [AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)
f2caa451fc 2019-10-27 [AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)
16d7accb22 2019-10-22 [AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)
4e661f535d 2019-10-22 [AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)
19e32b4e2c 2019-10-18 [AIRFLOW-5656] Rename provider to providers module (#6333)