Google services including:
- Google Ads
- Google Cloud (GCP)
- Google Firebase
- Google LevelDB
- Google Marketing Platform
- Google Workspace (formerly Google Suite)
This is detailed commit list of changes for versions provider package: google
.
For high-level changelog, see :doc:`package information including changelog <index>`.
Latest change: 2023-04-21
Commit | Committed | Subject |
---|---|---|
fbc1382514 | 2023-04-21 | remove delegate_to from GCP operators and hooks (#30748) |
b48f959ae9 | 2023-04-21 | Update DataprocCreateCluster operator to use 'label' parameter properly (#30741) |
da2749cae5 | 2023-04-15 | Update Google Campaign Manager360 operators to use API v4 (#30598) |
4eab616e9f | 2023-04-15 | add missing project_id in BigQueryGetDataOperator (#30651) |
57c09e59ee | 2023-04-14 | Display Video 360 cleanup v1 API usage (#30577) |
Latest change: 2023-04-12
Commit | Committed | Subject |
---|---|---|
0f3b6579cb | 2023-04-12 | Prepare docs for RC2 of provider wave (#30606) |
874ea9588e | 2023-04-09 | Prepare docs for ad hoc release of Providers (#30545) |
71db47a73d | 2023-04-09 | Update DV360 operators to use API v2 (#30326) |
3d2c96e3f5 | 2023-04-08 | Add deferrable mode to GKEStartPodOperator (#29266) |
4703f9a0e5 | 2023-04-08 | BigQueryHook list_rows/get_datasets_list can return iterator (#30543) |
d9896fd96e | 2023-04-08 | Fix dynamic imports in google ads vendored in library (#30544) |
d23a3bbed8 | 2023-04-04 | Add mechanism to suspend providers (#30422) |
2ba1e63c37 | 2023-04-04 | Fix cloud build async credentials (#30441) |
cc6fd5c0d9 | 2023-04-03 | Small quotation fix (#30448) |
Latest change: 2023-04-02
Commit | Committed | Subject |
---|---|---|
55dbf1ff1f | 2023-04-02 | Prepare docs for April 2023 wave of Providers (#30378) |
25048fa6b2 | 2023-04-01 | Switch to using vendored-in google ads. (#30410) |
2e65c70e99 | 2023-04-01 | Merging of the google ads vendored-in code. (#30399) |
540a076801 | 2023-03-30 | merge BigQueryTableExistenceAsyncSensor into BigQueryTableExistenceSensor (#30235) |
29eba167ea | 2023-03-22 | Merge BigQueryTableExistencePartitionAsyncSensor into BigQueryTableExistencePartitionSensor (#30231) |
79a2fa7db9 | 2023-03-21 | Merge GCSObjectExistenceAsyncSensor logic to GCSObjectExistenceSensor (#30014) |
af4627fec9 | 2023-03-20 | fix setting project_id for gs to bq and bq to gs (#30053) |
75fd5e8c54 | 2023-03-16 | Add missing 'poll_interval' in Bigquery operator (#30132) |
5a3be7256b | 2023-03-15 | Handling project location param on async BigQuery dts trigger (#29786) |
a6715805c7 | 2023-03-14 | Add poll_interval param in BigQueryInsertJobOperator (#30091) |
57fb80cff0 | 2023-03-14 | Support CloudDataTransferServiceJobStatusSensor without specifying a project_id (#30035) |
def1f89e70 | 2023-03-10 | Fix location on cloud build operators (#29937) |
599c587e26 | 2023-03-10 | Add 'job_id' to 'BigQueryToGCSOperator' templated_fields (#30006) |
c3867781e0 | 2023-03-08 | adding trigger info to provider yaml (#29950) |
b6392ae5fd | 2023-03-07 | Support deleting the local log files when using remote logging (#29772) |
464ab1b7ca | 2023-03-05 | Wait insert_job result in normal mode (#29925) |
f55b9576b1 | 2023-03-05 | 'GoogleDriveHook': Fixing log message + adding more verbose documentation (#29694) |
035ad26d79 | 2023-03-04 | Add "BOOLEAN" to type_map of MSSQLToGCSOperator, fix incorrect bit->int type conversion by specifying BIT fields explicitly (#29902) |
5a632f78eb | 2023-03-04 | Google Cloud Providers - Fix _MethodDefault deepcopy failure (#29518) |
971039454a | 2023-03-04 | Align cncf provider file names with AIP-21 (#29905) |
864ff2e3ce | 2023-03-04 | Remove unnecessary upper constraints from google provider (#29915) |
Latest change: 2023-03-03
Commit | Committed | Subject |
---|---|---|
fcd3c0149f | 2023-03-03 | Prepare docs for 03/2023 wave of Providers (#29878) |
3fc9461654 | 2023-03-03 | Add 'CloudSQLCloneInstanceOperator' (#29726) |
47ab0ca629 | 2023-03-03 | Move help message to the google auth code (#29888) |
972fca2253 | 2023-02-28 | Fix 'NoneType' object is not subscriptable. (#29820) |
ec844eaa0a | 2023-02-27 | Add deferrable mode to BigQueryTablePartitionExistenceSensor. (#29735) |
a5adb87ab4 | 2023-02-26 | Add a new param for BigQuery operators to support additional actions when resource exists (#29394) |
1e7c064560 | 2023-02-25 | Google Cloud Providers - Introduce GoogleCloudBaseOperator (#29680) |
ad08f66228 | 2023-02-22 | Remove <2.0.0 limit on google-cloud-bigtable (#29644) |
dba390e323 | 2023-02-22 | Fix and augment 'check-for-inclusive-language' CI check (#29549) |
f51742d20b | 2023-02-21 | Don't push secret in XCOM in BigQueryCreateDataTransferOperator (#29348) |
3dbcf99d20 | 2023-02-21 | Update google cloud dlp package and adjust hook and operators (#29234) |
6ef5ba9104 | 2023-02-20 | Refactor Dataproc Trigger (#29364) |
7e3a9fc858 | 2023-02-20 | Dataproc batches (#29136) |
1677d80e65 | 2023-02-20 | Add deferrable mode to DataprocInstantiateWorkflowTemplateOperator (#28618) |
Latest change: 2023-02-18
Commit | Committed | Subject |
---|---|---|
470fdaea27 | 2023-02-18 | Prepare docs for 02 2023 midmonth wave of Providers (#29589) |
f37772adfd | 2023-02-18 | 'GoogleDriveHook': Add folder_id param to upload_file (#29477) |
28126c12fb | 2023-02-14 | Add defer mode to GKECreateClusterOperator and GKEDeleteClusterOperator (#28406) |
32c571e592 | 2023-02-14 | Move cloud_sql_binary_path from connection to Hook (#29499) |
41fade2d21 | 2023-02-13 | Upgrade Mypy to 1.0 (#29468) |
5e6f8eb4d5 | 2023-02-13 | Check that cloud sql provider version is valid (#29497) |
f9e9d23457 | 2023-02-11 | Restore trigger logging (#29482) |
7ee1a56244 | 2023-02-11 | Add documentation for BigQuery transfer operators (#29466) |
60d4bcd1d1 | 2023-02-10 | Revert "Enable individual trigger logging (#27758)" (#29472) |
6c1eeb5839 | 2023-02-11 | Revert "Upgrade mypy to 0.991 (#28926)" (#29470) |
6ae0a80cba | 2023-02-11 | Upgrade mypy to 0.991 (#28926) |
Latest change: 2023-02-08
Commit | Committed | Subject |
---|---|---|
ce6ae2457e | 2023-02-08 | Prepare docs for Feb 2023 wave of Providers (#29379) |
1b18a501fe | 2023-02-03 | Enable individual trigger logging (#27758) |
872df121e2 | 2023-02-03 | Add deferrable capability to existing ''DataprocDeleteClusterOperator'' (#29349) |
094d6bf01b | 2023-01-30 | Add deferrable mode to dataflow operators (#27776) |
9d9351728c | 2023-01-30 | Add deferrable mode to DataprocCreateBatchOperator (#28457) |
9fd80130e2 | 2023-01-25 | Add deferrable mode to DataprocCreateClusterOperator and DataprocUpdateClusterOperator (#28529) |
02bebf897b | 2023-01-25 | Add deferrable mode to MLEngineStartTrainingJobOperator (#27405) |
cf90a1a567 | 2023-01-25 | Keyfile dict can be dict not str (#29135) |
b4c50dadd3 | 2023-01-24 | GCSTaskHandler may use remote log conn id (#29117) |
b2825e1185 | 2023-01-24 | Fix GoogleDriveHook writing files to trashed folders on upload v2 (#29119) |
be0e35321f | 2023-01-24 | fix Google provider CHANGELOG.rst (#29122) |
3374fdfcbd | 2023-01-23 | Deprecate 'delegate_to' param in GCP operators and update docs (#29088) |
7e2493e3c8 | 2023-01-23 | fix Google provider CHANGELOG.rst (#29114) |
90e6277da6 | 2023-01-23 | Auto ML assets (#25466) |
e926bb9bb0 | 2023-01-20 | Add deferrable mode to DataFusionStartPipelineOperator (#28690) |
5fcdd321c5 | 2023-01-20 | Add deferrable mode for Big Query Transfer operator (#27833) |
5350be2194 | 2023-01-19 | Add support for write_on_empty in BaseSQLToGCSOperator (#28959) |
dc3a3c7c52 | 2023-01-16 | Add DataprocCancelOperationOperator (#28456) |
Latest change: 2023-01-14
Commit | Committed | Subject |
---|---|---|
911b708ffd | 2023-01-14 | Prepare docs for Jan 2023 mid-month wave of Providers (#28929) |
ce858a5d71 | 2023-01-12 | Switch to ruff for faster static checks (#28893) |
f1eb2f1af4 | 2023-01-12 | 'BigQueryCreateExternalTableOperator' fix field delimiter not working with csv (#28856) |
a337e6209a | 2023-01-11 | Fix using private _get_credentials instead of public get_credentials (#28588) |
284cd52989 | 2023-01-10 | Add deferrable ''GCSObjectExistenceSensorAsync'' (#28763) |
35a8ffc55a | 2023-01-10 | Support partition_columns in BaseSQLToGCSOperator (#28677) |
c0b2fcff24 | 2023-01-09 | assign "datasetReference" attribute to dataset_reference dict. by default if not already set in create_empty_dataset method of bigquery hook (#28782) |
71306b31f1 | 2023-01-09 | Fix'GoogleCampaignManagerReportSensor' with 'QUEUED' status (#28735) |
c67f4af667 | 2023-01-09 | Fix BigQueryColumnCheckOperator runtime error (#28796) |
Latest change: 2023-01-02
Commit | Committed | Subject |
---|---|---|
5246c009c5 | 2023-01-02 | Prepare docs for Jan 2023 wave of Providers (#28651) |
fec1460eb7 | 2023-01-01 | Push job_id in xcom for dataproc submit job op (#28639) |
0fae6a0c9e | 2022-12-28 | Add table_resource to template fields for BigQueryCreateEmptyTableOperator (#28235) |
d7f5f6d737 | 2022-12-24 | GCSToBigQueryOperator allows autodetect None and infers schema (#28564) |
034039beb2 | 2022-12-24 | Remove 'pylint' messages control instructions (#28555) |
8fb7be2fb5 | 2022-12-22 | Set bigquery ''use_legacy_sql'' param in job config correctly (#28522) |
23264fb820 | 2022-12-21 | Fix for issue with reading schema fields for JSON files in GCSToBigQueryOperator (#28284) |
7950fb9711 | 2022-12-21 | Remove deprecated AIPlatformConsoleLinkk from google/provider.yaml (#28449) |
820f5a9374 | 2022-12-20 | Use object instead of array in config.yml for config template (#28417) |
9eacf607be | 2022-12-20 | Fix GCSToBigQueryOperator not respecting schema_obj (#28444) |
bdf3175e96 | 2022-12-06 | Improve memory usage in Dataproc deferrable operators (#28117) |
3fef462838 | 2022-12-06 | Fix GCSToGCSOperator copying list of objects without wildcard (#28111) |
2d663df055 | 2022-12-04 | Fix: re-enable use of parameters in gcs_to_bq which had been disabled (#27961) |
5cdff50557 | 2022-12-04 | Add retry param in GCSObjectExistenceSensor (#27943) |
8f98bfeb53 | 2022-12-03 | Add preserveAsciiControlCharacters to src_fmt_configs (#27679) |
4a3a429658 | 2022-12-03 | [misc] Get rid of 'pass' statement in conditions (#27775) |
6b3bb3c3e9 | 2022-12-03 | Change log level to DEBUG when secret not found for google secret manager (#27856) |
527b948856 | 2022-12-03 | [misc] Replace XOR '^' conditions by 'exactly_one' helper in providers (#27858) |
c931d88893 | 2022-12-03 | Add deferrable mode to CloudBuildCreateBuildOperator (#27783) |
Latest change: 2022-11-26
Commit | Committed | Subject |
---|---|---|
25bdbc8e67 | 2022-11-26 | Updated docs for RC3 wave of providers (#27937) |
f0820e8d9e | 2022-11-25 | Add Export Format to Template Fields in BigQueryToGCSOperator (#27910) |
2e20e9f7eb | 2022-11-24 | Prepare for follow-up relase for November providers (#27774) |
80c327bd3b | 2022-11-24 | Bump common.sql provider to 1.3.1 (#27888) |
bc0063af99 | 2022-11-16 | Fix to read location parameter properly in BigQueryToBigQueryOperator (#27661) |
0cb6450d6d | 2022-11-16 | Persist DataprocLink for workflow operators regardless of job status (#26986) |
ddbc758540 | 2022-11-16 | Deferrable mode for BigQueryToGCSOperator (#27683) |
Latest change: 2022-11-15
Commit | Committed | Subject |
---|---|---|
12c3c39d1a | 2022-11-15 | pRepare docs for November 2022 wave of Providers (#27613) |
00af5c007e | 2022-11-14 | Replace urlparse with urlsplit (#27389) |
1059de6294 | 2022-11-11 | Dataform operators, links, update system tests and docs (#27144) |
3aed495f50 | 2022-11-11 | Rename hook bigquery function '_bq_cast' to 'bq_cast' (#27543) |
e8ab8ccc0e | 2022-11-11 | Add backward compatibility with old versions of Apache Beam (#27263) |
59e3198f7e | 2022-11-10 | Change dataprep system tests assets (#26488) |
98a9c574e3 | 2022-11-08 | set project_id and location when canceling BigQuery job (#27521) |
a691ab56a6 | 2022-11-08 | Add new Compute Engine Operators and fix system tests (#25608) |
199359bb38 | 2022-11-07 | Use non-deprecated method for on_kill in BigQueryHook (#27547) |
7297892558 | 2022-11-07 | Remove unnecessary newlines around single arg in signature (#27525) |
5cd78cf425 | 2022-11-06 | Upgrade dependencies in order to avoid backtracking (#27531) |
332c01d6e0 | 2022-10-31 | Allow values in WorkflowsCreateExecutionOperator execution argument to be dicts (#27361) |
50d217a129 | 2022-10-31 | DataflowStopJobOperator Operator (#27033) |
eb8c0cf0d2 | 2022-10-31 | Migration of System Tests: Cloud Composer (AIP-47) (#27227) |
528ecbbc00 | 2022-10-31 | Rewrite system tests for ML Engine service (#26915) |
bcb026bf7c | 2022-10-31 | use the proper key to retrieve the dataflow job_id (#27336) |
42841f70d5 | 2022-10-31 | Migration of System Tests: Cloud BigQuery Data Transfer (AIP-47) (#27312) |
1447158e69 | 2022-10-31 | Typecast biquery job response col value (#27236) |
95e5675714 | 2022-10-31 | Migration of System Tests: Dataplex (AIP-47) (#26989) |
124fb3948d | 2022-10-31 | Add deferrable mode to GCPToBigQueryOperator + tests (#27052) |
7a7c5f8fc4 | 2022-10-31 | Add system tests for Vertex AI operators in new approach (#27053) |
4e55d7fa2b | 2022-10-31 | Migration of System Tests: Cloud Vision Operators (AIP-47) (#26963) |
896479d1a0 | 2022-10-31 | Google Drive to local - system tests migrations (AIP-47) (#26798) |
3d5f34cb0f | 2022-10-28 | Allow and prefer non-prefixed extra fields for dataprep hook (#27039) |
04f674c13b | 2022-10-27 | Migrate Bigtable operators system tests according to AIP-47 (#26911) |
58d61826a3 | 2022-10-27 | Migrate Dataproc Metastore system tests according to AIP-47 (#26858) |
9ab1a6a3e7 | 2022-10-27 | Update old style typing (#26872) |
87eb46bbc6 | 2022-10-26 | Common sql bugfixes and improvements (#26761) |
7653c61df8 | 2022-10-26 | Make GSheetsHook return an empty list when there are no values (#27261) |
78b8ea2f22 | 2022-10-24 | Move min airflow version to 2.3.0 for all providers (#27196) |
2a34dc9e84 | 2022-10-23 | Enable string normalization in python formatting - providers (#27205) |
58378cfd42 | 2022-10-23 | Cloud ML Engine operators assets (AIP-47) (#26836) |
de9633f93a | 2022-10-22 | Update google hooks to prefer non-prefixed extra fields (#27023) |
b54a2de8c7 | 2022-10-09 | Local filesystem to Google Drive Operator - system tests migration (AIP-47) (#26797) |
b4cef6da21 | 2022-10-09 | SFTP to Google Cloud Storage Transfer system tests migration (AIP-47) (#26799) |
6f0b600293 | 2022-10-09 | Fix delay in Dataproc CreateBatch operator (#26126) |
2f326a6c03 | 2022-10-06 | Remove <2 limit on google-cloud-storage (#26922) |
a67bcf3eca | 2022-10-06 | Allow for the overriding of stringify_dict for json/jsonb column data type in Postgres #26875 (#26876) |
Latest change: 2022-10-04
Commit | Committed | Subject |
---|---|---|
403ed7163f | 2022-10-04 | Add docs for Google/Slack RC providers (#26860) |
fa0cb363b8 | 2022-10-01 | Correcting the transfer config name. (#25719) |
cee610ae5c | 2022-10-01 | Fix parsing of optional 'mode' field in BigQuery Result Schema (#26786) |
b7203cd36e | 2022-10-01 | Fix MaxID logic for GCSToBigQueryOperator (#26768) |
f8db64c35c | 2022-09-28 | Update docs for September Provider's release (#26731) |
dce27557eb | 2022-09-28 | Fix GCS sensor system tests failing with DebugExecutor (#26742) |
26f94c5370 | 2022-09-26 | Cloud Data Loss Prevention Operators assets (#26618) |
01ac40af75 | 2022-09-22 | Update gcs.py (#26570) |
e61d823f18 | 2022-09-21 | Cloud Storage Transfer Operators assets & system tests migration (AIP-47) (#26072) |
a60e3b9317 | 2022-09-21 | Migrate Data Loss Prevention system tests according to AIP-47 (#26060) |
c4256ca1a0 | 2022-09-21 | Add BigQuery Column and Table Check Operators (#26368) |
4c33f6bcf5 | 2022-09-20 | Merge deferrable BigQuery operators to exisitng one (#26433) |
8e98b1c6df | 2022-09-20 | Google Drive to Google Cloud Storage Transfer Operator - system tests migration (AIP-47) (#26487) |
e315900396 | 2022-09-20 | specifying project id when calling wait_for_operation in delete/create cluster (#26418) |
6045f7ad69 | 2022-09-19 | Cloud Functions Operators assets & system tests migration (AIP-47) (#26073) |
1f7b296227 | 2022-09-18 | Auto tail file logs in Web UI (#26169) |
07fe356de0 | 2022-09-18 | GCSToBigQueryOperator Resolve 'max_id_key' job retrieval and xcom return (#26285) |
b4f8a069f0 | 2022-09-18 | Allow for the overriding of 'stringify_dict' for json export format on BaseSQLToGCSOperator (#26277) |
706a618014 | 2022-09-18 | Append GoogleLink base in the link class (#26057) |
97b144fbed | 2022-09-18 | Fix JSONDecodeError in Datafusion operators (#26202) |
9444d9789b | 2022-09-14 | Work around pyupgrade edge cases (#26384) |
d67ac5932d | 2022-09-14 | Apply PEP-563 (Postponed Evaluation of Annotations) to core airflow (#26290) |
06acf40a43 | 2022-09-13 | Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289) |
23ad7e292a | 2022-09-10 | Cloud Video Intelligence Operators assets & system tests migration (AIP-47) (#26132) |
3a539ff663 | 2022-09-09 | Life Science assets & system tests migration (AIP-47) (#25548) |
5066844513 | 2022-09-09 | D400 first line should end with period batch02 (#25268) |
f938cd4fc8 | 2022-09-08 | Add deferrable big query operators and sensors (#26156) |
8cac96918b | 2022-09-07 | GCSToBigQueryOperator allow for schema_object in alternate GCS Bucket (#26190) |
12cbc0f1dd | 2022-09-07 | Don't throw an exception when a BQ cusor job has no schema (#26096) |
8acdc2a834 | 2022-08-30 | Replace SQL with Common SQL in pre commit (#26058) |
1d06374194 | 2022-08-30 | Hook into Mypy to get rid of those cast() (#26023) |
da8f133053 | 2022-08-29 | Use AsyncClient for Composer Operators in deferrable mode (#25951) |
1ed014647e | 2022-08-29 | Add 'output' property to MappedOperator (#25604) |
d4eb60712d | 2022-08-27 | Use project_id to get authenticated client (#25984) |
4c3fb1ff2b | 2022-08-27 | Google Cloud Tasks Sensor for queue being empty (#25622) |
c81178063a | 2022-08-27 | Cloud Build assets & system tests migration (AIP-47) (#25895) |
62a46c1e18 | 2022-08-27 | Added append_job_name parameter to DataflowTemplatedJobStartOperator (#25746) |
15b49add28 | 2022-08-23 | Sql to GSC operators update docs for parquet format (#25878) |
25a9ae3b2e | 2022-08-23 | Limit Google Protobuf for compatibility with biggtable client (#25886) |
ecf0460b7d | 2022-08-22 | Dataproc submit job operator async (#25302) |
fc6dfa338a | 2022-08-20 | Support project_id argument in BigQueryGetDataOperator (#25782) |
6e66dd7776 | 2022-08-19 | Make GoogleBaseHook credentials functions public (#25785) |
6e41c7eb33 | 2022-08-16 | Fixed never ending loop to in CreateWorkflowInvocation (#25737) |
6c5b0776c0 | 2022-08-14 | Adding a parameter for exclusion of trashed files in GoogleDriveHook (#25675) |
1b412c9cbe | 2022-08-10 | Consolidate to one 'schedule' param (#25410) |
Latest change: 2022-08-10
Commit | Committed | Subject |
---|---|---|
e5ac6c7cfb | 2022-08-10 | Prepare docs for new providers release (August 2022) (#25618) |
2e2d4bffd5 | 2022-08-09 | Dataform operators (#25587) |
c8c4a42723 | 2022-08-08 | Fix GCSListObjectsOperator docstring (#25614) |
029e3ae96f | 2022-08-05 | Remove deprecated modules (#25543) |
7d2c2ee879 | 2022-08-04 | add description method in BigQueryCursor class (#25366) |
e84d753015 | 2022-08-04 | Fix BigQueryInsertJobOperator cancel_on_kill (#25342) |
803c0e252f | 2022-08-03 | Fix BaseSQLToGCSOperator approx_max_file_size_bytes (#25469) |
faf3c4fe47 | 2022-08-02 | Fix PostgresToGCSOperat bool dtype (#25475) |
c8cacad4d6 | 2022-08-02 | Migrate Google example trino_to_gcs to new design AIP-47 (#25420) |
d2900022a2 | 2022-08-02 | Migrate Google example automl_nl_text_extraction to new design AIP-47 (#25418) |
acab8f52dd | 2022-07-29 | Move all "old" SQL operators to common.sql providers (#25350) |
f6b48ac6df | 2022-07-28 | Memorystore assets & system tests migration (AIP-47) (#25361) |
f4b93cc097 | 2022-07-28 | Translate system tests migration (AIP-47) (#25340) |
a8e4519815 | 2022-07-28 | Fix Vertex AI Custom Job training issue (#25367) |
5d4abbd58c | 2022-07-27 | Deprecate hql parameters and synchronize DBApiHook method APIs (#25299) |
8bc147192c | 2022-07-27 | Fix Flask Login user setting for Flask 2.2 and Flask-Login 0.6.2 (#25318) |
28db8c10b2 | 2022-07-26 | Migrate Google example life_sciences to new design AIP-47 (#25264) |
10c9a3697a | 2022-07-26 | Migrate Google example natural_language to new design AIP-47 (#25262) |
b288bf4da4 | 2022-07-26 | Delete redundant system test bigquery_to_bigquery (#25261) |
c8af0592c0 | 2022-07-26 | Improve taskflow type hints with ParamSpec (#25173) |
df00436569 | 2022-07-22 | Unify DbApiHook.run() method with the methods which override it (#23971) |
66b3ca1d28 | 2022-07-21 | Migrate Google example bigquery_to_mssql to new design AIP-47 (#25174) |
9644451676 | 2022-07-19 | Migrate Google example compute_igm to new design AIP-47 (#25132) |
3a80b36ed9 | 2022-07-19 | Migrate Google example automl_vision to new design AIP-47 (#25152) |
c0ce8a8375 | 2022-07-18 | Migrate Google example gcs_to_sftp to new design AIP-47 (#25107) |
e32e9c5880 | 2022-07-18 | Bump typing-extensions and mypy for ParamSpec (#25088) |
4473b27d08 | 2022-07-16 | Migrate Google campaign manager example to new design AIP-47 (#25069) |
9b7e4a7324 | 2022-07-16 | Migrate Google analytics example to new design AIP-47 (#25006) |
77626b7fc8 | 2022-07-13 | Add project_id as a templated variable in two BQ operators (#24768) |
Latest change: 2022-07-13
Commit | Committed | Subject |
---|---|---|
d2459a241b | 2022-07-13 | Add documentation for July 2022 Provider's release (#25030) |
93992f2361 | 2022-07-12 | PubSub assets & system tests migration (AIP-47) (#24867) |
a13c51e224 | 2022-07-12 | Migrate Google sheets example to new design AIP-47 (#24975) |
a038b52b5a | 2022-07-12 | Migrate Google ads example to new design AIP-47 (#24941) |
c618da444e | 2022-07-12 | Modify BigQueryCreateExternalTableOperator to use updated hook function (#24363) |
626d9db290 | 2022-07-12 | Migrate Google example gcs_to_gdrive to new design AIP-47 (#24949) |
fb51e04cfd | 2022-07-12 | Migrate Google firestore example to new design AIP-47 (#24830) |
b777514253 | 2022-07-12 | Add handling state of existing Dataproc batch (#24924) |
acaa0635c8 | 2022-07-08 | Automatically detect if non-lazy logging interpolation is used (#24910) |
fb7162418e | 2022-07-07 | Add links for Google Kubernetes Engine operators (#24786) |
46bbfdade0 | 2022-07-07 | Move all SQL classes to common-sql provider (#24836) |
80b6754746 | 2022-07-06 | Migrate Google example sql_to_sheets to new design AIP-47 (#24814) |
3b35325840 | 2022-07-06 | Add test_connection method to 'GoogleBaseHook' (#24682) |
96b01a8012 | 2022-07-05 | Remove "bad characters" from our codebase (#24841) |
9227d56e68 | 2022-07-04 | Datacatalog assets & system tests migration (AIP-47) (#24600) |
fe13eae3bf | 2022-07-04 | perf(BigQuery): pass table_id as str type (#23141) |
37ea530cb7 | 2022-07-04 | Migrate Google example DAG mssql_to_gcs to new design AIP-47 (#24541) |
46ac083f7e | 2022-07-01 | Align Black and blacken-docs configs (#24785) |
0de31bd73a | 2022-06-29 | Move provider dependencies to inside provider folders (#24672) |
45b11d4ed1 | 2022-06-29 | Use our yaml util in all providers (#24720) |
510a6bab45 | 2022-06-28 | Remove 'hook-class-names' from provider.yaml (#24702) |
7a7ca50160 | 2022-06-28 | Migrate Google example DAG s3_to_gcs to new design AIP-47 (#24641) |
abb304c92f | 2022-06-25 | Migrate Google example DAG bigquery_transfer to new design AIP-47 (#24543) |
ded22eb5b6 | 2022-06-24 | Add gcp_conn_id argument to GoogleDriveToLocalOperator (#24622) |
e2f19505bf | 2022-06-22 | Upgrade FAB to 4.1.1 (#24399) |
9c59831ee7 | 2022-06-21 | Update providers to use functools compat for ''cached_property'' (#24582) |
88ddf65708 | 2022-06-20 | Migrate Google example DAG oracle_to_gcs to new design AIP-47 (#24542) |
32fc4be502 | 2022-06-20 | Migrate Google example DAG mysql_to_gcs to new design AIP-47 (#24540) |
a35f342833 | 2022-06-20 | Migrate Google search_ads DAG to new design AIP-47 (#24298) |
e7a1c50d62 | 2022-06-20 | GCSDeleteObjectsOperator empty prefix bug fix (#24353) |
dd35fdaf35 | 2022-06-20 | Migrate Google gcs_to_sheets DAG to new design AIP-47 (#24501) |
0561c1aac4 | 2022-06-19 | Add DeprecationWarning for column_transformations parameter in AutoML (#24467) |
Latest change: 2022-06-15
Commit | Committed | Subject |
---|---|---|
952a5ea8d8 | 2022-06-15 | Update release docs for Google and Oracle providers (#24461) |
ce50d3731a | 2022-06-15 | Use insert_job in the BigQueryToGCPOpertor and adjust links (#24416) |
2a084ee8d7 | 2022-06-14 | Update Oracle library to latest version (#24311) |
69c46252dd | 2022-06-14 | fix typo in google provider additional extras (#24431) |
08b675cf66 | 2022-06-13 | Fix links to sources for examples (#24386) |
94257f48f4 | 2022-06-13 | Expose SQL to GCS Metadata (#24382) |
8e0bddaea6 | 2022-06-12 | Deprecate remaining occurrences of 'bigquery_conn_id' in favor of 'gcp_conn_id' (#24376) |
6eb60f816c | 2022-06-12 | Migrate Google calendar example DAG to new design AIP-47 (#24333) |
bc3fc8c9fc | 2022-06-12 | Migrate Google azure_fileshare example DAG to new design AIP-47 (#24349) |
6ab02b69a0 | 2022-06-12 | Remove bigquery example already migrated to AIP-47 (#24379) |
cb90ca7afb | 2022-06-12 | Migrate Google sheets example DAG to new design AIP-47 (#24351) |
Latest change: 2022-06-09
Commit | Committed | Subject |
---|---|---|
dcdcf3a2b8 | 2022-06-09 | Update release notes for RC2 release of Providers for May 2022 (#24307) |
047a6162b0 | 2022-06-08 | Workaround job race bug on biguery to gcs transfer (#24330) |
717a7588bc | 2022-06-07 | Update package description to remove double min-airflow specification (#24292) |
b1ad017cee | 2022-06-07 | pydocstyle D202 added (#24221) |
aeabe994b3 | 2022-06-07 | Prepare docs for May 2022 provider's release (#24231) |
c3a9ef1ada | 2022-06-07 | AIP-47 - Migrate google leveldb DAGs to new design ##22447 (#24233) |
c23826915d | 2022-06-07 | Apply per-run log templates to log handlers (#24153) |
80c1ce76e1 | 2022-06-06 | Cloud Storage assets & StorageLink update (#23865) |
ec84ffe71c | 2022-06-06 | Fix GCSToGCSOperator cannot copy a single file/folder without copying other files/folders with that prefix (#24039) |
027b707d21 | 2022-06-05 | Add explanatory note for contributors about updating Changelog (#24229) |
55fd02a389 | 2022-06-04 | Add key_secret_project_id parameter which specifies a project with KeyFile (#23930) |
90233bc7cb | 2022-06-04 | Added impersonation_chain for DataflowStartFlexTemplateOperator and DataflowStartSqlJobOperator (#24046) |
c01a5a50b4 | 2022-06-04 | Fix BigQuery system tests (#24013) |
a597a76e8f | 2022-06-03 | fix BigQueryInsertJobOperator (#24165) |
e13b15946e | 2022-06-03 | Workflows assets & system tests migration (AIP-47) (#24105) |
368f292ca1 | 2022-06-03 | Update credentials when using ADC in Compute Engine (#23773) |
96e8fb4a07 | 2022-06-01 | Fix the link to google workplace (#24080) |
3dd7b1ddba | 2022-06-01 | set color to operators in cloud_sql.py (#24000) |
841ed27101 | 2022-06-01 | Spanner assets & system tests migration (AIP-47) (#23957) |
fedab9d64a | 2022-06-01 | Remove hack from BigQuery DTS hook (#23887) |
e58985598f | 2022-05-30 | Ensure @contextmanager decorates generator func (#23103) |
92ddcf4ac6 | 2022-05-27 | Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873) |
ec6761a5c0 | 2022-05-23 | Clean up f-strings in logging calls (#23597) |
65f3b18fc1 | 2022-05-22 | Sql to gcs with exclude columns (#23695) |
a43e98d050 | 2022-05-22 | Fix DataprocJobBaseOperator not being compatible with dotted names (#23439). (#23791) |
5bfacf81c6 | 2022-05-20 | [Issue#22846] allow option to encode or not encode UUID when uploading from Cassandra to GCS (#23766) |
f60fa98a2e | 2022-05-19 | Cloud SQL assets & system tests migration (AIP-47) (#23583) |
d3b0880286 | 2022-05-17 | Speech To Text assets & system tests migration (AIP-47) (#23643) |
3bf9a1df38 | 2022-05-16 | Add fields to CLOUD_SQL_EXPORT_VALIDATION. (#23724) |
bc0dcddfb5 | 2022-05-12 | Migrate Dataproc to new system tests design (#22777) |
Latest change: 2022-05-12
Commit | Committed | Subject |
---|---|---|
75c60923e0 | 2022-05-12 | Prepare provider documentation 2022.05.11 (#23631) |
cd49a8b9f6 | 2022-05-11 | [FEATURE] google provider - BigQueryInsertJobOperator log query (#23648) |
60a1d9d191 | 2022-05-10 | [FEATURE] google provider - split GkeStartPodOperator execute (#23518) |
74557e41e3 | 2022-05-10 | Add exportContext.offload flag to CLOUD_SQL_EXPORT_VALIDATION. (#23614) |
428a439953 | 2022-05-09 | Clean up in-line f-string concatenation (#23591) |
766726f2e3 | 2022-05-09 | Fix 'PostgresToGCSOperator' does not allow nested JSON (#23063) |
82c244f9c7 | 2022-05-08 | Fix GCSToGCSOperator ignores replace parameter when there is no wildcard (#23340) |
627b5698ec | 2022-05-04 | Add Stackdriver assets and migrate system tests to AIP-47 (#23320) |
3977e1798d | 2022-05-04 | CloudTasks assets & system tests migration (AIP-47) (#23282) |
dfe0f75938 | 2022-05-04 | TextToSpeech assets & system tests migration (AIP-47) (#23247) |
2d109401b3 | 2022-05-04 | Bump pre-commit hook versions (#22887) |
427e14b763 | 2022-05-03 | Fix code-snippets in google provider (#23438) |
fa0cc7cec7 | 2022-05-02 | Cleanup Google provider CHANGELOG.rst (#23390) |
3f6d5eef42 | 2022-05-01 | 'DataprocHook': Remove deprecated function 'submit' (#23389) |
511d0ee256 | 2022-04-30 | Bigquery assets (#23165) |
3f9845095e | 2022-04-29 | Remove redundant docstring in 'BigQueryUpdateTableSchemaOperator' (#23349) |
0fcdc5e1fb | 2022-04-29 | 'S3ToGCSOperator': Remove 'dest_gcs_conn_id' (#23348) |
05ccfd42f2 | 2022-04-29 | Dataproc: Remove default value of 'region' (#23350) |
359dc58207 | 2022-04-29 | Google provider: Remove 'bigquery_conn_id', 'google_cloud_storage_conn_id' (#23326) |
c82b3b9466 | 2022-04-28 | 'GCSFileTransformOperator': New templated fields 'source_object', 'destination_object' (#23328) |
9449a107f0 | 2022-04-28 | 'DatastoreHook': Remove 'datastore_conn_id' (#23323) |
1f32603549 | 2022-04-28 | update processor to fix broken download URLs (#23299) |
8a7b61a8e4 | 2022-04-28 | Migrate gcs to new system tests design (#22778) |
72e2ea68a1 | 2022-04-27 | 'CloudBuildCreateBuildOperator': Remove deprecated 'body' parameter (#23263) |
6cf0176f2a | 2022-04-27 | Remove deprecated parameters from PubSub operators: (#23261) |
4d9c55c9d9 | 2022-04-27 | Remove deprecated parameters from BigQueryHook: (#23269) |
915b0c689e | 2022-04-27 | add missing docstring in 'BigQueryHook.create_empty_table' (#23270) |
710eb6f3e6 | 2022-04-26 | * 'CloudDatastoreImportEntitiesOperator' : Remove 'xcom_push'. Please use 'BaseOperator.do_xcom_push' (#23252) |
2d569fdaf0 | 2022-04-26 | Create links for Biqtable operators (#23164) |
434ab5a03c | 2022-04-26 | 'BigtableCreateInstanceOperator' & 'BigtableHook.create_instance' Remove 'replica_cluster_id', 'replica_cluster_zone'. (#23251) |
5ca1f3bf70 | 2022-04-26 | Dataproc : remove 'location' in favor of 'region' (#23250) |
1416ac4195 | 2022-04-26 | 'PubSubPullSensor': Remove 'project' and 'return_immediately' (#23231) |
06dfc2536c | 2022-04-26 | Remove deprecated 'params' from google operators (#23230) |
37a7b27242 | 2022-04-26 | 'LookerStartPdtBuildOperator', 'LookerCheckPdtBuildSensor' : fix empty materialization id handling (#23025) |
967140e6c3 | 2022-04-25 | Add location support to BigQueryDataTransferServiceTransferRunSensor. |
d6094e58ba | 2022-04-25 | Fix static checks |
22ea28f23e | 2022-04-25 | Remove run_in_gke_cluster flag |
c46d04eb2d | 2022-04-25 | Create system test for K8s and dataproc operators |
35cbc89c3a | 2022-04-25 | Create Dataproc operators for GKE |
27ad3b7827 | 2022-04-25 | Remove 'GCSObjectsWtihPrefixExistenceSensor' |
544d658921 | 2022-04-25 | Change CloudDatastoreExportEntitiesLink to StorageLink |
b3cc2f5d10 | 2022-04-25 | Fix pre-commit check |
43ded6c877 | 2022-04-25 | Add links for Cloud Datastore operators |
de65a5cc5a | 2022-04-25 | Support serviceAccount attr for dataflow in the Apache beam |
76dc7375b2 | 2022-04-25 | Migrate Datastore system tests to new design (AIP-47) |
0373fb0247 | 2022-04-25 | 'GoogleDriveToGCSOperator': Remove 'destination_bucket' and 'destination_object' |
6b459995b2 | 2022-04-25 | Add the format of Vertex Endpoint ID to the docstrings |
27af0b7ebe | 2022-04-25 | Add the new parameter to the docstring |
48abf571be | 2022-04-25 | Add 'endpoint_id' arg to 'google.cloud.operators.vertex_ai.CreateEndpointOperator' |
8b6b0848a3 | 2022-04-23 | Use new Breese for building, pulling and verifying the images. (#23104) |
07a13bb708 | 2022-04-21 | Change ComputeSSH to throw provider import error instead paramiko (#23035) |
c36bcc4c06 | 2022-04-15 | Upgrade to support Google Ads v10 (#22965) |
ea1ae1963e | 2022-04-14 | Fix cancel_on_kill after execution timeout for DataprocSubmitJobOperator (#22955) |
9a623e94cb | 2022-04-13 | migrate system test gcs_to_bigquery into new design (#22753) |
aa317d92ea | 2022-04-13 | Fix select * query xcom push for BigQueryGetDataOperator (#22936) |
27b3e31178 | 2022-04-11 | implements #22859 - Add .sql as templatable extension (#22920) |
03e1c9b152 | 2022-04-11 | MSSQLToGCSOperator fails: datetime is not JSON Serializable (#22882) |
6933022e94 | 2022-04-10 | Fix new MyPy errors in main (#22884) |
6aa65a38e0 | 2022-04-08 | Add example DAG for demonstrating usage of GCS sensors (#22808) |
Latest change: 2022-04-07
Commit | Committed | Subject |
---|---|---|
56ab82ed7a | 2022-04-07 | Prepare mid-April provider documentation. (#22819) |
838cf401b9 | 2022-04-06 | Fail ''LocalFilesystemToGCSOperator'' if src does not exist (#22772) |
99b0211d50 | 2022-04-04 | Modify transfer operators to handle more data (#22495) |
f9e18472c0 | 2022-04-04 | Add autodetect arg in BQCreateExternalTable Operator (#22710) |
327eab3e26 | 2022-03-31 | Add links for BigQuery Data Transfer (#22280) |
02976bef88 | 2022-03-27 | Refactor: BigQuery to GCS Operator (#22506) |
719135ade0 | 2022-03-27 | Remove references to deprecated operators/params in PubSub operators (#22519) |
ca4b8d1744 | 2022-03-27 | Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI service (#22088) |
388723950d | 2022-03-27 | PostgresToGoogleCloudStorageOperator - BigQuery schema type for time zone naive fields (#22536) |
c063fc688c | 2022-03-25 | Update black precommit (#22521) |
3c7cd47319 | 2022-03-25 | New design of system tests (#22311) |
7ab45d41d6 | 2022-03-24 | Update secrets backends to use get_conn_value instead of get_conn_uri (#22348) |
d231e9b448 | 2022-03-24 | Remove coerce_datetime usage from GCSTimeSpanFileTransformOperator (#22501) |
82a26c0591 | 2022-03-24 | Fix the docstrings (#22497) |
38fde2ea79 | 2022-03-23 | Fix 'download_media' url in 'GoogleDisplayVideo360SDFtoGCSOperator' (#22479) |
0f0a1a7d22 | 2022-03-23 | Fix to 'CloudBuildRunBuildTriggerOperator' fails to find build id. (#22419) |
Latest change: 2022-03-22
Commit | Committed | Subject |
---|---|---|
d7dbfb7e26 | 2022-03-22 | Add documentation for bugfix release of Providers (#22383) |
7b851edc91 | 2022-03-21 | Add 'LocalFilesystemToGoogleDriveOperator' (#22219) |
14e6b657c2 | 2022-03-21 | Add timeout and retry to the BigQueryInsertJobOperator (#22395) |
a3ffbee7c9 | 2022-03-20 | Fix skipping non-GCS located jars (#22302) |
88402038ca | 2022-03-19 | Add dataflow_default_options to templated_fields (#22367) |
6448b2458c | 2022-03-15 | [FIX] typo doc of gcs operator (#22290) |
Latest change: 2022-03-14
Commit | Committed | Subject |
---|---|---|
16adc035b1 | 2022-03-14 | Add documentation for Classifier release for March 2022 (#22226) |
87c1246b79 | 2022-03-14 | Add Dataplex operators (#20377) |
c1ab8e2d7b | 2022-03-14 | Protect against accidental misuse of XCom.get_value() (#22244) |
c108f264ab | 2022-03-13 | Change the default 'chunk_size' to a clear representation & add documentation (#22222) |
45435399fe | 2022-03-13 | Support Uploading Bigger Files to Google Drive (#22179) |
42a891d605 | 2022-03-13 | Update ''GKEDeleteClusterOperator', ''GKECreateClusterOperator'' docstrings (#22212) |
d08284ed25 | 2022-03-11 | `` Add map_index to XCom model and interface (#22112)`` |
828d1cba4d | 2022-03-10 | Add support for ARM platform (#22127) |
4ac771c316 | 2022-03-09 | Fix spelling (#22107) |
dd0724fdd2 | 2022-03-08 | Add guide for DataprocInstantiateInlineWorkflowTemplateOperator (#22062) |
dfd9805a23 | 2022-03-08 | Use yaml safe load (#22091) |
eba9703751 | 2022-03-08 | Revert "Use yaml safe load (#22085)" (#22089) |
7f4935bab3 | 2022-03-08 | Use yaml safe load (#22085) |
a11d831e3f | 2022-03-07 | Allow for uploading metadata with GCS Hook Upload (#22058) |
Latest change: 2022-03-07
Commit | Committed | Subject |
---|---|---|
f5b96315fe | 2022-03-07 | Add documentation for Feb Providers release (#22056) |
6db9b0029b | 2022-03-07 | Add Looker PDT operators (#20882) |
9020b3a89d | 2022-03-06 | Add autodetect arg to external table creation in GCSToBigQueryOperator (#21944) |
a0e2ebaa27 | 2022-03-02 | Unpin 'google-cloud-memcache' (#21912) |
84ed747db8 | 2022-03-02 | Unpin ''pandas-gbq'' and remove unused code (#21915) |
fb6b2d1fee | 2022-03-01 | Make project_id argument optional in all dataproc operators (#21866) |
08575ddd8a | 2022-03-01 | Change BaseOperatorLink interface to take a ti_key, not a datetime (#21798) |
6ca118dff1 | 2022-03-01 | Allow templates in more DataprocUpdateClusterOperator fields (#21865) |
0c55ca2cda | 2022-02-28 | Suppress hook warnings from the Bigquery transfers (#20119) |
73eb24f25c | 2022-02-24 | Fix bigquery_dts parameter docstring typo (#21786) |
3b4c26eb3a | 2022-02-23 | Add Dataproc assets/links (#21756) |
6061cc4219 | 2022-02-20 | Add Auto ML operators for Vertex AI service (#21470) |
295efd36ea | 2022-02-17 | Dataflow Assets (#21639) |
af2c047320 | 2022-02-16 | Add GoogleCalendarToGCSOperator (#20769) |
1b568d73e1 | 2022-02-15 | Extract ClientInfo to module level (#21554) |
dc03000de8 | 2022-02-15 | Datafusion assets (#21518) |
56365b102c | 2022-02-15 | Dataproc metastore assets (#21267) |
6692e9191d | 2022-02-15 | Normalize *_conn_id parameters in BigQuery sensors (#21430) |
2eb10565b2 | 2022-02-15 | Fixed PostgresToGCSOperator fail on empty resultset for use_server_side_cursor=True (#21307) |
da1e6578e0 | 2022-02-15 | Fix multi query scenario in bigquery example DAG (#21575) |
Latest change: 2022-02-14
Commit | Committed | Subject |
---|---|---|
28378d867a | 2022-02-14 | Add documentation for RC3 release of providers for Jan 2022 (#21553) |
6bb0857df9 | 2022-02-13 | (providers_google) add a location check in bigquery (#19571) |
6579648af2 | 2022-02-13 | Fix bigquery-hook when no engine_kwargs are passed |
da485da29a | 2022-02-13 | Add support for BeamGoPipelineOperator (#20386) |
05a883b35e | 2022-02-11 | Google Cloud Composer opearators (#21251) |
833087f4f9 | 2022-02-10 | Enable asynchronous job submission in BigQuery hook (#21385) |
51aff276ca | 2022-02-10 | Optionally raise an error if source file does not exist in GCSToGCSOperator (#21391) |
07fe9e8c6a | 2022-02-09 | Never set DagRun.state to State.NONE (#21263) |
0a3ff43d41 | 2022-02-08 | Add pre-commit check for docstring param types (#21398) |
d94fa37830 | 2022-02-08 | Fixed changelog for January 2022 (delayed) provider's release (#21439) |
e973740208 | 2022-02-08 | Create CustomJob and Datasets operators for Vertex AI service (#21253) |
34d63fabc0 | 2022-02-08 | Fix BigQueryDataTransferServiceHook.get_transfer_run() request parameter (#21293) |
6b88d432d9 | 2022-02-06 | Support to upload file to Google Shared Drive (#21319) |
1a77bc6481 | 2022-02-06 | :bug: (BigQueryHook) fix compatibility with sqlalchemy engine (#19508) |
6c3a67d4fc | 2022-02-05 | Add documentation for January 2021 providers release (#21257) |
39e395f981 | 2022-02-04 | Add more SQL template fields renderers (#21237) |
e840acf8d1 | 2022-02-04 | Fix BigQuery system test (#21320) |
ddb5246bd1 | 2022-02-03 | Refactor operator links to not create ad hoc TaskInstances (#21285) |
1d4b709e20 | 2022-01-28 | Revert "Create CustomJob and Datasets operators for Vertex AI service (#20077)" (#21203) |
48d44b885b | 2022-01-28 | Cloudsql import links fix. (#21199) |
640c0b6763 | 2022-01-28 | Create CustomJob and Datasets operators for Vertex AI service (#20077) |
cb73053211 | 2022-01-27 | Add optional features in providers. (#21074) |
60aa518ebf | 2022-01-26 | batch as templated field in DataprocCreateBatchOperator (#20905) |
623163f16a | 2022-01-25 | Extend dataproc example dag (#21091) |
86ef016eab | 2022-01-23 | Make timeout Optional for wait_for_operation (#20981) |
506efb6fa3 | 2022-01-21 | Squelch more deprecation warnings (#21003) |
372849486c | 2022-01-21 | Fix last google provider MyPy errors (#21010) |
73c0d241d8 | 2022-01-21 | Remove a few stray ':type's in docs (#21014) |
602abe8394 | 2022-01-20 | Remove ':type' lines now sphinx-autoapi supports typehints (#20951) |
b8526abc2c | 2022-01-19 | Add encoding parameter to 'GCSToLocalFilesystemOperator' to fix #20901 (#20919) |
58452f97db | 2022-01-03 | Add hook for integrating with Google Calendar (#20542) |
Latest change: 2021-12-31
Commit | Committed | Subject |
---|---|---|
f77417eb0d | 2021-12-31 | Fix K8S changelog to be PyPI-compatible (#20614) |
97496ba2b4 | 2021-12-31 | Update documentation for provider December 2021 release (#20523) |
a22d5bd076 | 2021-12-31 | Fix mypy errors in Google Cloud provider (#20611) |
4233ebe5ce | 2021-12-31 | Fix setting of project ID in ''provide_authorized_gcloud'' (#20428) |
83f8e178ba | 2021-12-31 | Even more typing in operators (template_fields/ext) (#20608) |
746ee587da | 2021-12-31 | Delete pods by default in KubernetesPodOperator (#20575) |
41dbe2c4fc | 2021-12-30 | Fix mypy errors in google/cloud/operators/stackdriver (#20601) |
dda688776c | 2021-12-30 | Fix Google mlengine MyPy errors (#20569) |
d56e7b56bb | 2021-12-30 | Fix template_fields type to have MyPy friendly Sequence type (#20571) |
bd9e8cef26 | 2021-12-30 | Fix Google Mypy Dataproc errors (#20570) |
a6e60ce25d | 2021-12-30 | Change download_video parameter to resourceName (#20528) |
af4a2b0240 | 2021-12-30 | Fix big query to mssql/mysql transfer issues (#20001) |
a0821235fb | 2021-12-30 | Use typed Context EVERYWHERE (#20565) |
da88ed1943 | 2021-12-29 | Fix MyPy errors in Google Cloud (again) (#20469) |
3a480f5ff4 | 2021-12-29 | Fix passing the gzip compression parameter on sftp_to_gcs. (#20553) |
bfd6d45cec | 2021-12-29 | switch to follow_redirects on httpx.get call in CloudSQL provider (#20239) |
7d4d38b546 | 2021-12-29 | avoid deprecation warnings in BigQuery transfer operators (#20502) |
b7086f9815 | 2021-12-28 | Use Python3.7+ syntax in pyupgrade (#20501) |
a4622e19fa | 2021-12-22 | Support regional GKE cluster (#18966) |
2ffdcf4b41 | 2021-12-21 | Fixes docstring for PubSubCreateSubscriptionOperator (#20237) |
d4c4f9e09e | 2021-12-21 | Fix mypy errors for google.cloud_build (#20234) |
c6dbb3f885 | 2021-12-21 | Fix MyPy for Google Bigquery (#20329) |
ed604b62f3 | 2021-12-18 | Fix remaining MyPy errors in Google Provider (#20358) |
17404f1f10 | 2021-12-16 | Move source_objects datatype check out of GCSToBigQueryOperator.__init__ (#20347) |
174681911f | 2021-12-16 | Fix MyPy Errors for dataproc package (#20327) |
2fb5e1d0ec | 2021-12-15 | Fix cached_property MyPy declaration and related MyPy errors (#20226) |
21b8661886 | 2021-12-15 | Fix missing get_backup method for Dataproc Metastore (#20326) |
cdaa9a2529 | 2021-12-15 | Fix MyPy errors for google.cloud.tasks (#20233) |
43efde6230 | 2021-12-15 | Fix MyPy Errors for Apache Beam (and Dataflow) provider. (#20301) |
c4b3694101 | 2021-12-15 | Fix MyPy errors in leveldb (#20222) |
1570519a97 | 2021-12-14 | Fix MyPy errors for google.cloud.transfers (#20229) |
632bd0133e | 2021-12-13 | Fix MyPY errors for google.cloud.example_dags (#20232) |
644051abcb | 2021-12-13 | Fix MyPy errors for google/marketing_platform and suite (#20227) |
a208463802 | 2021-12-13 | Organize S3 Classes in Amazon Provider (#20167) |
98514cc159 | 2021-12-13 | Add optional location to bigquery data transfer service (#15088) (#20221) |
1f662571b2 | 2021-12-12 | Fix MyPy errors in google.cloud.sensors (#20228) |
22341b90da | 2021-12-11 | Add Google Cloud Tasks how-to documentation (#20145) |
e9262752dc | 2021-12-11 | Finalised Datastore documentation (#20138) |
fa96b09395 | 2021-12-09 | Update Sphinx and Sphinx-AutoAPI (#20079) |
ed8b63ba24 | 2021-12-08 | Providers facebook hook multiple account (#19377) |
50bf536656 | 2021-12-08 | Remove deprecated method call (blob.download_as_string) (#20091) |
564fe635bd | 2021-12-06 | Added example DAG for MSSQL to Google Cloud Storage (GCS) (#19873) |
cb082d361a | 2021-12-02 | Remove deprecated template_fields from GoogleDriveToGCSOperator (#19991) |
6977c47572 | 2021-12-01 | BigQueryHook fix typo in run_load doc string (#19924) |
f6dca1fa5e | 2021-12-01 | Update doc reference links (#19909) |
Latest change: 2021-11-30
Commit | Committed | Subject |
---|---|---|
853576d901 | 2021-11-30 | Update documentation for November 2021 provider's release (#19882) |
fb478c00cd | 2021-11-28 | Move 'bucket_name' validation out of '__init__' in Google Marketing Platform operators (#19383) |
e9e530979a | 2021-11-28 | Update 'default_args' value in example_functions DAG from str to int (#19865) |
bf68b9a846 | 2021-11-26 | Create dataproc serverless spark batches operator (#19248) |
a192cecf6b | 2021-11-26 | updates pipeline_timeout CloudDataFusionStartPipelineOperator (#18773) |
eb163c81d1 | 2021-11-25 | Fix GCS system tests (#19227) |
744d11bdb2 | 2021-11-25 | Clean up ''default_args'' usage in docs (#19803) |
0b2e1a8744 | 2021-11-22 | Added wait mechanizm to the DataprocJobSensor to avoid 509 errors when Job is not available (#19740) |
3336bb6c3c | 2021-11-19 | Fix badly merged impersonation in GKEPodOperator (#19696) |
952ef908bc | 2021-11-19 | Support impersonation_chain parameter in the GKEStartPodOperator (#19518) |
853c16465a | 2021-11-18 | Clean-up of google cloud example dags - batch 3 (#19664) |
355dec8fea | 2021-11-17 | Misc. documentation typos and language improvements (#19599) |
b9d31cd449 | 2021-11-17 | Cleanup dynamic 'start_date' use for miscellaneous Google example DAGs (#19400) |
daf234bd5e | 2021-11-16 | Remove reference to deprecated operator in example_dataproc (#19619) |
48f228cf9e | 2021-11-15 | #16691 Providing more information in docs for DataprocCreateCluster operator migration (#19446) |
6ef44b6a50 | 2021-11-15 | Clean-up of google cloud example dags - batch 2 (#19527) |
dc0159e7e4 | 2021-11-14 | Add support in GCP connection for reading key from Secret Manager (#19164) |
4212c49324 | 2021-11-14 | Update Azure modules to comply with AIP-21 (#19431) |
aa2cb5545f | 2021-11-12 | Remove remaining 'pylint: disable' comments (#19541) |
c8dc0311da | 2021-11-08 | Fix Cloud SQL system tests (#19014) |
26ad55beb0 | 2021-11-08 | Add dataproc metastore operators (#18945) |
9efb989d19 | 2021-11-07 | Clean-up of google cloud example dags (#19436) |
f421409b4d | 2021-11-05 | Fix typos in warnings, docstrings, exceptions (#19424) |
a3c9956f79 | 2021-10-30 | Add support of 'path' parameter for GCloud Storage Transfer Service operators (#17446) |
Latest change: 2021-10-29
Commit | Committed | Subject |
---|---|---|
d9567eb106 | 2021-10-29 | Prepare documentation for October Provider's release (#19321) |
55abc2f620 | 2021-10-28 | Support query timeout as an argument in CassandraToGCSOperator (#18927) |
e4aa377da7 | 2021-10-28 | Update BigQueryCreateExternalTableOperator doc and parameters (#18676) |
20847fdbf8 | 2021-10-27 | Add value to "namespaceId" of query (#19163) |
3c08c025c5 | 2021-10-27 | Move validation of templated input params to run after the context init (#19048) |
eba1b68b30 | 2021-10-27 | Update dataflow.py (#19231) |
7ecf29f70d | 2021-10-26 | Fix hard-coded /tmp directory in CloudSQL Hook (#19229) |
726a1517ec | 2021-10-26 | Fix bug in Dataflow hook when no jobs are returned (#18981) |
d9192a55ba | 2021-10-22 | Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052) |
4fae04a471 | 2021-10-21 | Upgrade the Dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879) |
0e95b57772 | 2021-10-19 | Google provider catch invalid secret name (#18790) |
86a2a19ad2 | 2021-10-17 | More f-strings (#18855) |
a418fd96f7 | 2021-10-17 | Use google cloud credentials when executing beam command in subprocess (#18992) |
5c3e453820 | 2021-10-15 | Fix BigQueryToMsSqlOperator documentation (#18995) |
406b38b2e3 | 2021-10-15 | Replace default api_version of FacebookAdsReportToGcsOperator (#18996) |
1571f80546 | 2021-10-14 | Add pre-commit hook for common misspelling check in files (#18964) |
20df60de24 | 2021-10-07 | Dataflow Operators - use project and location from job in on_kill method. (#18699) |
86bf2a29ba | 2021-10-04 | Simplify strings previously split across lines (#18679) |
Latest change: 2021-09-30
Commit | Committed | Subject |
---|---|---|
840ea3efb9 | 2021-09-30 | Update documentation for September providers release (#18613) |
9279c44c91 | 2021-09-29 | Fix part of Google system tests (#18494) |
2fadf3c3cf | 2021-09-27 | Fix kubernetes engine system test (#18548) |
a458fcc573 | 2021-09-27 | Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278) |
97d6892318 | 2021-09-25 | Rename AzureDataLakeStorage to ADLS (#18493) |
a5439eee72 | 2021-09-23 | Add index to the dataset name to have separate dataset for each example DAG (#18459) |
18d7e1e227 | 2021-09-21 | Fix BigQuery system test (#18373) |
e25eea052f | 2021-09-19 | Inclusive Language (#18349) |
7458f1e786 | 2021-09-18 | Remove check for at least one schema in GCSToBigquery (#18150) |
2474f8922d | 2021-09-13 | Migrate Google Cloud Build from Discovery API to Python SDK (#18184) |
8ae2bb9bfa | 2021-09-13 | Fix error when create external table using table resource (#17998) |
9140ad8d8f | 2021-09-11 | Use parameters instead of params (#18143) |
3d4bfdcbb9 | 2021-09-10 | Add missing __init__.py files for some test packages (#18142) |
cfb602a33d | 2021-09-10 | Fix ''BigQuery'' data extraction in ''BigQueryToMySqlOperator'' (#18073) |
2fd3f27ebd | 2021-09-10 | Make next_dagrun_info take a data interval (#18088) |
944dcfbb91 | 2021-09-07 | Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719) |
bfad233b91 | 2021-09-06 | Fix providers tests in main branch with eager upgrades (#18040) |
21348c194d | 2021-09-03 | fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006) |
9a0c10ba3f | 2021-09-01 | deduplicate running jobs on BigQueryInsertJobOperator (#17496) |
fe34582fc2 | 2021-09-01 | New google operator: SQLToGoogleSheetsOperator (#17887) |
500780651c | 2021-08-31 | Add possibility to run DAGs from system tests and see DAGs logs (#17868) |
Latest change: 2021-08-30
Commit | Committed | Subject |
---|---|---|
0a68588479 | 2021-08-30 | Add August 2021 Provider's documentation (#17890) |
b5da846dd1 | 2021-08-30 | Fix missing Data Fusion sensor integration (#17914) |
07405e6df4 | 2021-08-30 | [AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787) |
42e13e1a5a | 2021-08-30 | Remove all deprecation warnings in providers (#17900) |
aa5952e58c | 2021-08-27 | Gcp ai hyperparameter tuning (#17790) |
87769db98f | 2021-08-27 | Allow omission of 'initial_node_count' if 'node_pools' is specified (#17820) |
be75dcd39c | 2021-08-23 | Update description about the new ''connection-types'' provider meta-data |
d04aa13526 | 2021-08-20 | [Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137) |
76ed2a49c6 | 2021-08-19 | Import Hooks lazily individually in providers manager (#17682) |
b68d1935f9 | 2021-08-19 | Add error check for config_file parameter in GKEStartPodOperator (#17700) |
29aab6434f | 2021-08-17 | Adds secrets backend/logging/auth information to provider yaml (#17625) |
b06d528603 | 2021-08-11 | Don't cache Google Secret Manager client (#17539) |
67cbb0f181 | 2021-08-02 | Enable specifying dictionary paths in 'template_fields_renderers' (#17321) |
c384f9b0f5 | 2021-07-29 | GCP Secret Manager error handling for missing credentials (#17264) |
Latest change: 2021-07-26
Commit | Committed | Subject |
---|---|---|
87f408b1e7 | 2021-07-26 | Prepares docs for Rc2 release of July providers (#17116) |
448e50bd23 | 2021-07-26 | Updating Google Cloud example DAGs to use XComArgs (#16875) |
aaf44ccace | 2021-07-26 | Updating miscellaneous Google example DAGs to use XComArgs (#16876) |
d01cc945dd | 2021-07-26 | Fixes several failing tests after broken main (#17222) |
babc4250f3 | 2021-07-26 | Fixes statich check failures (#17218) |
5d2224795b | 2021-07-25 | Google Ads Hook: Support newer versions of the google-ads library (#17160) |
966b250199 | 2021-07-25 | Fix GCStoGCS operator with replace diabled and existing destination object (#16991) |
763919d415 | 2021-07-25 | Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162) |
81bd40933e | 2021-07-23 | [CASSANDRA-16814] Fix cassandra to gcs type inconsistency. (#17183) |
026ffe65d4 | 2021-07-19 | fix: dataprocpysparkjob project_id as self.project_id (#17075) |
d02ded65ea | 2021-07-15 | Fixed wrongly escaped characters in amazon's changelog (#17020) |
b916b75079 | 2021-07-15 | Prepare documentation for July release of providers. (#17015) |
a3f5c93806 | 2021-07-13 | Update alias for field_mask in Google Memmcache (#16975) |
b0f7f91fe2 | 2021-07-07 | Standardise dataproc location param to region (#16034) |
866a601b76 | 2021-06-28 | Removes pylint from our toolchain (#16682) |
Latest change: 2021-06-18
Commit | Committed | Subject |
---|---|---|
bbc627a3da | 2021-06-18 | Prepares documentation for rc2 release of Providers (#16501) |
cbf8001d76 | 2021-06-16 | Synchronizes updated changelog after buggfix release (#16464) |
8a9c337838 | 2021-06-15 | Remove class references in changelogs (#16454) |
1fba5402bb | 2021-06-15 | More documentation update for June providers release (#16405) |
3c5cc42e13 | 2021-06-14 | Fix deprecation warnings location in google provider (#16403) |
b272f9cec9 | 2021-06-13 | fix: ensure datetime-related values fully compatible with MySQL and BigQuery (#15026) |
7f8f75eb80 | 2021-06-12 | Add BigQueryToMsSqlOperator (#15422) |
0c80a7d411 | 2021-06-11 | Fixes AzureFileShare connection extras (#16388) |
9c94b72d44 | 2021-06-07 | Updated documentation for June 2021 provider release (#16294) |
1e647029e4 | 2021-06-01 | Rename the main branch of the Airflow repo to be 'main' (#16149) |
99d1535287 | 2021-05-31 | Fix: GCS To BigQuery source_object (#16160) |
e1137523d4 | 2021-05-30 | Fix: Unnecessary downloads in ''GCSToLocalFilesystemOperator'' (#16171) |
904709d34f | 2021-05-27 | Check synctatic correctness for code-snippets (#16005) |
86768859c6 | 2021-05-26 | Fix bigquery type error when export format is parquet (#16027) |
6ae9aeec3f | 2021-05-26 | pass wait_for_done parameter down to _DataflowJobsController (#15541) |
476d0f6e3d | 2021-05-22 | Bump pyupgrade v2.13.0 to v2.18.1 (#15991) |
aa4713e43f | 2021-05-21 | Use api version only in GoogleAdsHook not operators (#15266) |
76a80bb17c | 2021-05-19 | Move plyvel to google provider extra (#15812) |
bb115da0b7 | 2021-05-17 | Get rid of requests as core dependency (#15781) |
9c8391a13f | 2021-05-10 | Fix spelling (#15699) |
3711a29e5e | 2021-05-09 | Fix argument ordering and type of bucket and object (#15738) |
a01567c471 | 2021-05-08 | Fix sql_to_gcs docstring lint error (#15730) |
f3fada9101 | 2021-05-07 | Add short description to BaseSQLToGCSOperator docstring (#15728) |
37681bca00 | 2021-05-07 | Auto-apply apply_default decorator (#15667) |
b8c0fde38a | 2021-05-07 | Add extra links for google dataproc (#10343) |
3b4fdd0a7a | 2021-05-06 | add oracle connection link (#15632) |
cf6324e43b | 2021-05-04 | Implement BigQuery Table Schema Update Operator (#15367) |
0f97a3970d | 2021-05-04 | Rename example bucket names to use INVALID BUCKET NAME by default (#15651) |
Latest change: 2021-05-01
Commit | Committed | Subject |
---|---|---|
807ad32ce5 | 2021-05-01 | Prepares provider release after PIP 21 compatibility (#15576) |
814e471d13 | 2021-04-29 | Update pre-commit checks (#15583) |
bf2b48174a | 2021-04-27 | Add Connection Documentation for Providers (#15499) |
4b031d39e1 | 2021-04-27 | Make Airflow code Pylint 2.8 compatible (#15534) |
e229f3541d | 2021-04-27 | Use Pip 21.* to install airflow officially (#15513) |
71c673e427 | 2021-04-22 | Update Docstrings of Modules with Missing Params (#15391) |
3b9a91806e | 2021-04-22 | Bugfix: Fix rendering of ''object_name'' in ''GCSToLocalFilesystemOperator'' (#15487) |
c5e302030d | 2021-04-21 | Fix typo in DataprocCreateClusterOperator (#15462) |
42a1ca8aab | 2021-04-20 | Fixes wrongly specified path for leveldb hook (#15453) |
6da36bad2c | 2021-04-18 | [Airflow-15245] - passing custom image family name to the DataProcClusterCreateoperator (#15250) |
f649905606 | 2021-04-15 | fix docstring typos (#15392) |
7bf69edca0 | 2021-04-08 | Fix typo in a docstring (#15276) |
Latest change: 2021-04-06
Commit | Committed | Subject |
---|---|---|
042be2e4e0 | 2021-04-06 | Updated documentation for provider packages before April release (#15236) |
eae22cec9c | 2021-04-06 | Adds 'Trino' provider (with lower memory footprint for tests) (#15187) |
e49722859b | 2021-04-05 | Updates 3.6 limits for latest versions of a few libraries (#15209) |
1d641d8f11 | 2021-04-01 | update remaining old import paths of operators (#15127) |
099c490cff | 2021-03-28 | Override project in dataprocSubmitJobOperator (#14981) |
5379698892 | 2021-03-27 | Improve docstrings for various modules (#15047) |
a7ca1b3b0b | 2021-03-26 | Fix Sphinx Issues with Docstrings (#14968) |
a7e144bec8 | 2021-03-23 | Google Dataflow Hook to handle no Job Type (#14914) |
72ea841b4b | 2021-03-22 | GCS to BigQuery Transfer Operator with Labels and Description parameter (#14881) |
e172bd0e16 | 2021-03-22 | Update docstrings to adhere to sphinx standards (#14918) |
68e4c4dcb0 | 2021-03-20 | Remove Backport Providers (#14886) |
ddc9133d36 | 2021-03-15 | Add GCS timespan transform operator (#13996) |
943baff670 | 2021-03-10 | Add job labels to bigquery check operators. (#14685) |
6dc24c95e3 | 2021-03-07 | Fix grammar and remove duplicate words (#14647) |
e7bb17aeb8 | 2021-03-06 | Use built-in 'cached_property' on Python 3.8 where possible (#14606) |
7daebefd15 | 2021-03-05 | Use libyaml C library when available. (#14577) |
35c9a90292 | 2021-03-01 | Add Google leveldb hook and operator (#13109) (#14105) |
Latest change: 2021-02-27
Commit | Committed | Subject |
---|---|---|
589d6dec92 | 2021-02-27 | Prepare to release the next wave of providers: (#14487) |
50a1504c52 | 2021-02-27 | Fix spellings (#14483) |
bfef559cf6 | 2021-02-27 | Corrects order of argument in docstring in GCSHook.download method (#14497) |
33214d9326 | 2021-02-26 | Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677) |
c281979982 | 2021-02-23 | Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033) |
ca35bd7f7f | 2021-02-21 | By default PIP will install all packages in .local folder (#14125) |
a7e4266d67 | 2021-02-21 | Refactor GoogleDriveToGCSOperator to use common methods (#14276) |
1ab406663e | 2021-02-16 | Add GoogleDriveToLocalOperator (#14191) |
59c94c679e | 2021-02-13 | Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026) |
e31b27d593 | 2021-02-13 | Add materialized view support for BigQuery (#14201) |
e3bcaa3ba3 | 2021-02-12 | Correct typo in GCSObjectsWtihPrefixExistenceSensor (#14179) |
7faa2d978c | 2021-02-10 | Add BigQueryUpdateTableOperator (#14149) |
1da6972165 | 2021-02-10 | Fixes to dataproc operators and hook (#14086) |
02288cf2ba | 2021-02-10 | Add param to CloudDataTransferServiceOperator (#14118) |
7d38645472 | 2021-02-09 | #9803 fix bug in copy operation without wildcard (#13919) |
b0c382426c | 2021-02-07 | Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982) |
5d7d46bb33 | 2021-02-05 | Improve GCSToSFTPOperator paths handling (#11284) |
10343ec29f | 2021-02-05 | Corrections in docs and tools after releasing provider RCs (#14082) |
Latest change: 2021-02-04
Commit | Committed | Subject |
---|---|---|
88bdcfa0df | 2021-02-04 | Prepare to release a new wave of providers. (#14013) |
1872d8719d | 2021-02-03 | Add Apache Beam operators (#12814) |
0e8c77b93a | 2021-02-03 | Support google-cloud-logging' >=2.0.0 (#13801) |
833e338323 | 2021-02-02 | Fix four bugs in StackdriverTaskHandler (#13784) |
d2efb33239 | 2021-02-02 | Support google-cloud-monitoring>=2.0.0 (#13769) |
ac2f72c98d | 2021-02-01 | Implement provider versioning tools (#13767) |
823741cfea | 2021-01-28 | Improve GCS system test envs (#13946) |
6d6588fe2b | 2021-01-28 | Add Google Cloud Workflows Operators (#13366) |
810c15ed85 | 2021-01-27 | Fix and improve GCP BigTable hook and system test (#13896) |
6616617331 | 2021-01-27 | Add env variables to PubSub example dag (#13794) |
f473ca7130 | 2021-01-24 | Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851) |
a9ac2b040b | 2021-01-23 | Switch to f-strings using flynt. (#13732) |
9592be88e5 | 2021-01-22 | Fix Google Spanner example dag (#13842) |
af52fdb511 | 2021-01-22 | Improve environment variables in GCP Dataflow system test (#13841) |
e7946f1cb7 | 2021-01-22 | Improve environment variables in GCP Datafusion system test (#13837) |
61c1d6ec6c | 2021-01-22 | Improve environment variables in GCP Memorystore system test (#13833) |
202f66093a | 2021-01-22 | Improve environment variables in GCP Lifeciences system test (#13834) |
70bf307f38 | 2021-01-21 | Add How To Guide for Dataflow (#13461) |
3fd5ef3555 | 2021-01-21 | Add missing logos for integrations (#13717) |
309788e5e2 | 2021-01-18 | Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256) |
7ec858c452 | 2021-01-17 | updated Google DV360 Hook to fix SDF issue (#13703) |
ef8617ec9d | 2021-01-14 | Support google-cloud-tasks>=2.0.0 (#13347) |
189af54043 | 2021-01-13 | Add system tests for Stackdriver operators (#13644) |
a6f999b62e | 2021-01-11 | Support google-cloud-automl >=2.1.0 (#13505) |
947dbb73bb | 2021-01-11 | Support google-cloud-datacatalog>=3.0.0 (#13534) |
2fb68342b0 | 2021-01-07 | Replace deprecated module and operator in example_tasks.py (#13527) |
003584bbf1 | 2021-01-05 | Fix failing backport packages test (#13497) |
7d1ea4cb10 | 2021-01-05 | Replace deprecated module and operator in example_tasks.py (#13473) |
c7d75ad887 | 2021-01-05 | Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482) |
feb84057d3 | 2021-01-04 | Support google-cloud-datacatalog 3.0.0 (#13224) |
3a3e739981 | 2021-01-04 | Fix insert_all method of BigQueryHook to support tables without schema (#13138) |
c33d2c06b6 | 2021-01-02 | Fix another pylint c-extension-no-member (#13438) |
f6518dd6a1 | 2021-01-02 | Generalize MLEngineStartTrainingJobOperator to custom images (#13318) |
9de7127083 | 2020-12-31 | Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337) |
406181d64a | 2020-12-31 | Add Parquet data type to BaseSQLToGCSOperator (#13359) |
295d66f914 | 2020-12-30 | Fix Grammar in PIP warning (#13380) |
13a9747bf1 | 2020-12-28 | Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341) |
04ec45f045 | 2020-12-28 | Add DataprocCreateWorkflowTemplateOperator (#13338) |
1f712219fa | 2020-12-28 | Support google-cloud-tasks>=2.0.0 (#13334) |
f4745c8ce1 | 2020-12-26 | Fix typo in example (#13321) |
e9d65bd458 | 2020-12-24 | Decode Remote Google Logs (#13115) |
e7aeacf335 | 2020-12-24 | Add OracleToGCS Transfer (#13246) |
323084e97d | 2020-12-24 | Add timeout option to gcs hook methods. (#13156) |
0b626c8042 | 2020-12-22 | Support google-cloud-redis>=2.0.0 (#13117) |
9042a58553 | 2020-12-22 | Add more operators to example DAGs for Cloud Tasks (#13235) |
8c00ec89b9 | 2020-12-22 | Support google-cloud-pubsub>=2.0.0 (#13127) |
b26b0df5b0 | 2020-12-22 | Update compatibility with google-cloud-kms>=2.0 (#13124) |
9a1d3820d6 | 2020-12-22 | Support google-cloud-datacatalog>=1.0.0 (#13097) |
f95b1c9c95 | 2020-12-21 | Add regional support to dataproc workflow template operators (#12907) |
6cf76d7ac0 | 2020-12-18 | Fix typo in pip upgrade command :( (#13148) |
23f27c1b1c | 2020-12-18 | Add system tests for CloudKMSHook (#13122) |
cddbf81b12 | 2020-12-17 | Fix Google BigQueryHook method get_schema() (#13136) |
1259c712a4 | 2020-12-17 | Update compatibility with google-cloud-os-login>=2.0.0 (#13126) |
bcf77586ef | 2020-12-16 | Fix Data Catalog operators (#13096) |
5090fb0c89 | 2020-12-15 | Add script to generate integrations.json (#13073) |
b4b9cf5597 | 2020-12-14 | Check for missing references to operator guides (#13059) |
1c1ef7ee69 | 2020-12-14 | Add project_id to client inside BigQuery hook update_table method (#13018) |
Latest change: 2020-12-09
Commit | Committed | Subject |
---|---|---|
32971a1a2d | 2020-12-09 | Updates providers versions to 1.0.0 (#12955) |
b40dffa085 | 2020-12-08 | Rename remaing modules to match AIP-21 (#12917) |
9b39f24780 | 2020-12-08 | Add support for dynamic connection form fields per provider (#12558) |
1dcd3e13fd | 2020-12-05 | Add support for extra links coming from the providers (#12472) |
2037303eef | 2020-11-29 | Adds support for Connection/Hook discovery from providers (#12466) |
02d94349be | 2020-11-29 | Don't use time.time() or timezone.utcnow() for duration calculations (#12353) |
76bcd08dca | 2020-11-28 | Added '@apply_defaults' decorator. (#12620) |
e1ebfa68b1 | 2020-11-27 | Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249) |
3fa51f94d7 | 2020-11-24 | Add check for duplicates in provider.yaml files (#12578) |
c34ef853c8 | 2020-11-20 | Separate out documentation building per provider (#12444) |
9e3b2c554d | 2020-11-19 | GCP Secrets Optional Lookup (#12360) |
0080354502 | 2020-11-18 | Update provider READMEs for 1.0.0b2 batch release (#12449) |
7ca0b6f121 | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438) |
8d09506464 | 2020-11-18 | Fix download method in GCSToBigQueryOperator (#12442) |
2c0920fba5 | 2020-11-17 | Adds mechanism for provider package discovery. (#12383) |
2cda2f2a0a | 2020-11-17 | Add missing pre-commit definition - provider-yamls (#12393) |
80a957f142 | 2020-11-17 | Add Dataflow sensors - job metrics (#12039) |
ae7cb4a1e2 | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
917e6c4424 | 2020-11-16 | Add provide_file_and_upload to GCSHook (#12310) |
cfa4ecfeb0 | 2020-11-15 | Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726) |
6889a333cf | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
7825e8f590 | 2020-11-13 | Docs installation improvements (#12304) |
32b59f8350 | 2020-11-12 | Fixes the sending of an empty list to BigQuery 'list_rows' (#12307) |
250436d962 | 2020-11-10 | Fix spelling in Python files (#12230) |
502ba309ea | 2020-11-10 | Enable Markdownlint rule - MD022/blanks-around-headings (#12225) |
dd2095f4a8 | 2020-11-10 | Simplify string expressions & Use f-string (#12216) |
f37c6e6fce | 2020-11-10 | Add Compute Engine SSH hook (#9879) |
85a18e13d9 | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
59eb5de78c | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
61feb6ec45 | 2020-11-09 | Provider's readmes generated for elasticsearch and google packages (#12194) |
b2a28d1590 | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
fcb6b00efe | 2020-11-08 | Add authentication to AWS with Google credentials (#12079) |
2ef3b7ef8c | 2020-11-08 | Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172) |
0caec9fd32 | 2020-11-06 | Dataflow - add waiting for successful job cancel (#11501) |
cf9437d79f | 2020-11-06 | Simplify string expressions (#12123) |
91a64db505 | 2020-11-04 | Format all files (without excepions) by black (#12091) |
fd3db778e7 | 2020-11-04 | Add server side cursor support for postgres to GCS operator (#11793) |
f1f1940261 | 2020-11-04 | Add DataflowStartSQLQuery operator (#8553) |
41bf172c1d | 2020-11-04 | Simplify string expressions (#12093) |
5f5244b74d | 2020-11-04 | Add template fields renderers to Biguery and Dataproc operators (#12067) |
4e8f9cc8d0 | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
8c42cf1b00 | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
45ae145c25 | 2020-11-03 | Log BigQuery job id in insert method of BigQueryHook (#12056) |
e324b37a67 | 2020-11-03 | Add job name and progress logs to Cloud Storage Transfer Hook (#12014) |
6071fdd584 | 2020-11-02 | Improve handling server errors in DataprocSubmitJobOperator (#11947) |
2f703df12d | 2020-10-30 | Add SalesforceToGcsOperator (#10760) |
e5713e00b3 | 2020-10-29 | Add drain option when canceling Dataflow pipelines (#11374) |
37eaac3c5d | 2020-10-29 | The PRs which are not approved run subset of tests (#11828) |
79cb771992 | 2020-10-28 | Fixing re pattern and changing to use a single character class. (#11857) |
5a439e84eb | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
240c7d4d72 | 2020-10-26 | Google Memcached hooks - improve protobuf messages handling (#11743) |
8afdb6ac6a | 2020-10-26 | Fix spellings (#11825) |
872b1566a1 | 2020-10-25 | Generated backport providers readmes/setup for 2020.10.29 (#11826) |
6ce855af11 | 2020-10-24 | Fix spelling (#11821) |
4830687453 | 2020-10-24 | Use Python 3 style super classes (#11806) |
727c739afb | 2020-10-22 | Improve Cloud Memorystore for Redis example (#11735) |
1da8379c91 | 2020-10-22 | Fix static checks after merging #10121 (#11737) |
91503308c7 | 2020-10-22 | Add Google Cloud Memorystore Memcached Operators (#10121) |
950c16d0b0 | 2020-10-21 | Retry requests in case of error in Google ML Engine Hook (#11712) |
2bfc53b5eb | 2020-10-21 | Fix doc errors in google provider files. (#11713) |
53e6062105 | 2020-10-21 | Enforce strict rules for yamllint (#11709) |
349b0811c3 | 2020-10-20 | Add D200 pydocstyle check (#11688) |
2d854c3505 | 2020-10-19 | Add service_account to Google ML Engine operator (#11619) |
46a121fb7b | 2020-10-18 | docs: Update Bigquery clustering docstrings (#11232) |
49c58147fe | 2020-10-18 | Strict type checking for provider Google (#11609) |
0823d46a7f | 2020-10-16 | Add type annotations for AWS operators and hooks (#11434) |
3c10ca6504 | 2020-10-16 | Add DataflowStartFlexTemplateOperator (#8550) |
8865d14df4 | 2020-10-16 | Strict type checking for provider google cloud (#11548) |
16e7129719 | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
06141d6d01 | 2020-10-12 | Google cloud operator strict type check (#11450) |
d305876bee | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
1845cd11b7 | 2020-10-11 | Strict type check for google ads and cloud hooks (#11390) |
bd204bb91b | 2020-10-11 | Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409) |
75071831ba | 2020-10-10 | Remove redundant parentheses from Python files (#10967) |
8baf657fc2 | 2020-10-09 | Fix regression in DataflowTemplatedJobStartOperator (#11167) |
b0fcf67559 | 2020-10-07 | Add AzureFileShareToGCSOperator (#10991) |
47b05a87f0 | 2020-10-07 | Improve handling of job_id in BigQuery operators (#11287) |
0a0e1af800 | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
ca4238eb4d | 2020-10-02 | Fixed month in backport packages to October (#11242) |
5220e4c384 | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
cb52fb0ae1 | 2020-09-27 | Add example DAG and system test for MySQLToGCSOperator (#10990) |
99accec29d | 2020-09-25 | Fix incorrect Usage of Optional[str] & Optional[int] (#11141) |
e3f96ce7a8 | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
daf8f31080 | 2020-09-23 | Add template fields renderers for better UI rendering (#11061) |
f3e87c5030 | 2020-09-22 | Add D202 pydocstyle check (#11032) |
cb979f9f21 | 2020-09-22 | Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024) |
76545bb3d6 | 2020-09-16 | Add example dag and system test for S3ToGCSOperator (#10951) |
22c631625f | 2020-09-16 | Fix more docs spellings (#10965) |
12a652f534 | 2020-09-13 | Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869) |
41a62735ed | 2020-09-11 | Add on_kill method to BigQueryInsertJobOperator (#10866) |
3e91da56e8 | 2020-09-11 | fix typo in firebase/example_filestore DAG (#10875) |
68cc7273bf | 2020-09-10 | Add on_kill method to DataprocSubmitJobOperator (#10847) |
f920957214 | 2020-09-10 | Fix and remove some more typos from spelling_wordlist.txt (#10845) |
9549274d11 | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
078bfaf60a | 2020-09-08 | Extract missing gcs_to_local example DAG from gcs example (#10767) |
10ce31127f | 2020-09-08 | Deprecate using global as the default region in Google Dataproc operators and hooks (#10772) |
f14f379716 | 2020-09-07 | [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773) |
c8ee455685 | 2020-09-07 | Refactor DataprocCreateCluster operator to use simpler interface (#10403) |
ece685b5b8 | 2020-09-05 | Asynchronous execution of Dataproc jobs with a Sensor (#10673) |
6e3d7b63d3 | 2020-09-04 | Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578) |
804548d58f | 2020-09-01 | Add Dataprep operators (#10304) |
11c00bc820 | 2020-08-30 | Fix typos: duplicated "the" (#10647) |
2ca615cffe | 2020-08-29 | Update Google Cloud branding (#10642) |
1b533f617e | 2020-08-28 | Fix broken master - DLP (#10635) |
5ae82a56da | 2020-08-28 | Fix Google DLP example and improve ops idempotency (#10608) |
3867f76625 | 2020-08-28 | Update Google Cloud branding (#10615) |
91ff31ad10 | 2020-08-27 | Documentation for Google Cloud Data Loss Prevention (#8201) (#9651) |
fdd9b6f65b | 2020-08-25 | Enable Black on Providers Packages (#10543) |
d760265452 | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
d1bce91bb2 | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
866701c801 | 2020-08-25 | Fix typo in "Cloud" (#10534) |
47265e7b58 | 2020-08-24 | Fix typo in PostgresHook (#10529) |
3696c34c28 | 2020-08-24 | Fix typo in the word "release" (#10528) |
2f2d8dbfaf | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
3734876d98 | 2020-08-24 | Implement impersonation in google operators (#10052) |
b0598b5351 | 2020-08-24 | Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475) |
ee7ca128a1 | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
515cc72c99 | 2020-08-22 | Fix typo in timed_out (#10459) |
7c206a82a6 | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
88c7d2e526 | 2020-08-21 | Dataflow operators don't not always create a virtualenv (#10373) |
083c3c129b | 2020-08-18 | Simplified GCSTaskHandler configuration (#10365) |
1ae5bdf23e | 2020-08-17 | Add test for GCSTaskHandler (#9600) (#9861) |
e195a980bc | 2020-08-16 | Add type annotations for mlengine_operator_utils (#10297) |
382c1011b6 | 2020-08-16 | Add Bigtable Update Instance Hook/Operator (#10340) |
bfa5a8d5f1 | 2020-08-15 | CI: Fix failing docs-build (#10342) |
be46d20fb4 | 2020-08-15 | Improve idempotency of BigQueryInsertJobOperator (#9590) |
47387a69e6 | 2020-08-14 | Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326) |
2f0613b0c2 | 2020-08-13 | Implement Google BigQuery Table Partition Sensor (#10218) |
f6734b3b85 | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
8f8db8959e | 2020-08-12 | DbApiHook: Support kwargs in get_pandas_df (#9730) |
ef088314f8 | 2020-08-09 | Added DataprepGetJobsForJobGroupOperator (#10246) |
b43f90abf4 | 2020-08-09 | Fix various typos in the repo (#10263) |
c29533888f | 2020-08-08 | Add labels param to Google MLEngine Operators (#10222) |
cdec301254 | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
eff0f03210 | 2020-08-06 | `` Update guide for Google Cloud Secret Manager Backend (#10172)`` |
24c8e4c2d6 | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
010322692e | 2020-08-06 | Improve handling Dataproc cluster creation with ERROR state (#9593) |
1437cb7495 | 2020-08-04 | Add correct signatures for operators in google provider package (#10144) |
6efa1b9cb7 | 2020-08-03 | Add additional Cloud Datastore operators (#10032) |
27020f8e58 | 2020-08-03 | Add try clause to DataFusionHook.wait_for_pipeline_state (#10031) |
4e3799fec4 | 2020-08-02 | [AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117) |
85c56b1737 | 2020-08-02 | Add missing params to GCP Pub/Sub creation_subscription (#10106) |
b79466c12f | 2020-08-02 | Fix sensor not providing arguments for GCSHook (#10074) |
4ee35d0279 | 2020-08-02 | Fix hook not passing gcp_conn_id to base class (#10075) |
aeea71274d | 2020-08-02 | Remove 'args' parameter from provider operator constructors (#10097) |
4c84661adb | 2020-07-31 | Split Display Video 360 example into smaler DAGs (#10077) |
59cbff0874 | 2020-07-29 | Fix docstrings in BigQueryGetDataOperator (#10042) |
81b87d48ed | 2020-07-27 | Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996) |
7d24b088cd | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
8b10a4b35e | 2020-07-25 | Stop using start_date in default_args in example_dags (#9982) |
ef98edf4da | 2020-07-23 | Add more information about using GoogleAdsHook (#9951) |
33f0cd2657 | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
39a0288a47 | 2020-07-22 | Add Google Authentication for experimental API (#9848) |
c2db0dfeb1 | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
c4244e18bb | 2020-07-22 | Fix calling 'get_client' in BigQueryHook.table_exists (#9916) |
5eacc16420 | 2020-07-22 | Add support for impersonation in GCP hooks (#9915) |
1cfdebf5f8 | 2020-07-21 | Fix insert_job method of BigQueryHook (#9899) |
c8c52e69c8 | 2020-07-21 | Remove type hint causing DeprecationWarning in Firestore operators (#9819) |
eb6f1d1cf0 | 2020-07-16 | Fix typo in datafusion operator (#9859) |
b01d95ec22 | 2020-07-15 | Change DAG.clear to take dag_run_state (#9824) |
6d65c15d15 | 2020-07-15 | Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798) |
770de53eb5 | 2020-07-15 | BigQueryTableExistenceSensor needs to specify keyword arguments (#9832) |
2d8dbacdf6 | 2020-07-15 | Add CloudVisionDeleteReferenceImageOperator (#9698) |
9f017951b9 | 2020-07-15 | Add Google Deployment Manager Hook (#9159) |
ed5004cca7 | 2020-07-14 | Allow 'replace' flag in gcs_to_gcs operator. (#9667) |
553bb7af7c | 2020-07-13 | Keep functions signatures in decorators (#9786) |
68925904e4 | 2020-07-13 | Add multiple file upload functionality to GCS hook (#8849) |
1de78e8f97 | 2020-07-12 | Add Google Stackdriver link (#9765) |
092d33f298 | 2020-07-11 | Fix StackdriverTaskHandler + add system tests (#9761) |
b2305660f0 | 2020-07-09 | Update example DAG for AI Platform operators (#9727) |
23f80f34ad | 2020-07-08 | Move gcs & wasb task handlers to their respective provider packages (#9714) |
44d4ae809c | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
a79e2d4c4a | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
cd3d9d9340 | 2020-07-02 | Fix using .json template extension in GMP operators (#9566) |
4799af30ee | 2020-06-30 | Extend BigQuery example with include clause (#9572) |
e33f1a12d7 | 2020-06-30 | Add template_ext to BigQueryInsertJobOperator (#9568) |
40add26d45 | 2020-06-29 | Remove almost all references to airflow.contrib (#9559) |
c420dbd6e1 | 2020-06-27 | Bump Pylint to 2.5.3 (#9294) |
0051c89cba | 2020-06-26 | nitpick fix (#9527) |
87fdbd0708 | 2020-06-25 | Use literal syntax instead of function calls to create data structure (#9516) |
7256f4caa2 | 2020-06-22 | Pylint fixes and deprecation of rare used methods in Connection (#9419) |
e13a14c873 | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
5b680e27e8 | 2020-06-19 | Don't use connection to store task handler credentials (#9381) |
d0e7db4024 | 2020-06-19 | Fixed release number for fresh release (#9408) |
416334e2ec | 2020-06-19 | Properly propagated warnings in operators (#9348) |
12af6a0800 | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
c7e5bce57f | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
4e09c64423 | 2020-06-18 | Adds GCP Secret Manager Hook (#9368) |
40bf8f28f9 | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
f6bd817a3a | 2020-06-16 | Introduce 'transfers' packages (#9320) |
639972d995 | 2020-06-16 | Add support for latest Apache Beam SDK in Dataflow operators (#9323) |
1459970b3b | 2020-06-15 | Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314) |
431ea3291c | 2020-06-15 | Resolve upstream tasks when template field is XComArg (#8805) |
aee6ab94eb | 2020-06-15 | Wait for pipeline state in Data Fusion operators (#8954) |
fb1c8b83d4 | 2020-06-10 | Add test for BQ operations using location (#9206) |
a26afbfa51 | 2020-06-10 | Make generated job_id more informative in BQ insert_job (#9203) |
c41192fa1f | 2020-06-10 | Upgrade pendulum to latest major version ~2.0 (#9184) |
b1c8c5ed5b | 2020-06-09 | Allows using private endpoints in GKEStartPodOperator (#9169) |
5918efc86a | 2020-06-05 | Add 3.8 to the test matrices (#8836) |
9bcdadaf7e | 2020-06-05 | Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154) |
f56811dff3 | 2020-06-05 | [AIRFLOW-6290] Create guide for GKE operators (#8883) |
76962867b5 | 2020-06-04 | Fix sql_to_gcs hook gzip of schema_file (#9140) |
17adcea835 | 2020-06-02 | Fix handling of subprocess error handling in s3_file_transform and gcs (#9106) |
7898525468 | 2020-06-01 | Add BigQueryInsertJobOperator (#8868) |
29eb68b90b | 2020-05-31 | Create guide for Dataproc Operators (#9037) |
886afaf622 | 2020-05-29 | Add example dag and system test for LocalFilesystemToGCSOperator (#9043) |
a779c4dfc2 | 2020-05-29 | add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066) |
ada26be23c | 2020-05-29 | Add correct description for dst param in LocalFilesystemToGCSOperator (#9055) |
81b2761b86 | 2020-05-29 | add example dag and system test for GoogleSheetsToGCSOperator (#9056) |
0b0e4f7a4c | 2020-05-26 | Preparing for RC3 relase of backports (#9026) |
00642a46d0 | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
3994030ea6 | 2020-05-26 | Refactor BigQuery operators (#8858) |
cdb3f25456 | 2020-05-26 | All classes in backport providers are now importable in Airflow 1.10 (#8991) |
1d36b0303b | 2020-05-23 | Fix references in docs (#8984) |
cf5cf45e1c | 2020-05-23 | Support YAML input for CloudBuildCreateOperator (#8808) |
499493c5c5 | 2020-05-19 | [AIRFLOW-6586] Improvements to gcs sensor (#7197) |
375d1ca229 | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
841d816647 | 2020-05-19 | Allow setting the pooling time in DLPHook (#8824) |
12c5e5d8ae | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
f3521fb0e3 | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
15273f0ea0 | 2020-05-16 | Check for same task instead of Equality to detect Duplicate Tasks (#8828) |
92585ca4cb | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
e1e833bb26 | 2020-05-13 | Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816) |
8b54919711 | 2020-05-12 | Refactor BigQuery hook methods to use python library (#8631) |
6911dfe837 | 2020-05-12 | Fix template fields in Google operators (#8840) |
4b06fde0f1 | 2020-05-12 | Fix Flake8 errors (#8841) |
1d12c347cb | 2020-05-12 | Refactor BigQuery check operators (#8813) |
493b685d78 | 2020-05-10 | Add separate example DAGs and system tests for google cloud speech (#8778) |
79ef8bed89 | 2020-05-10 | Added Upload Multiple Entity Read Files to specified big query dataset (#8610) |
280f1f0c4c | 2020-05-10 | Correctly restore upstream_task_ids when deserializing Operators (#8775) |
58aefb23b1 | 2020-05-08 | Added SDFtoGCSOperator (#8740) |
723c52c942 | 2020-05-07 | Add documentation for SpannerDeployInstanceOperator (#8750) |
25ee4211b3 | 2020-05-06 | Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531) |
8d6f1aa4b5 | 2020-05-05 | Support num_retries field in env var for GCP connection (#8700) |
67caae0f25 | 2020-05-04 | Add system test for gcs_to_bigquery (#8556) |
bc45fa6759 | 2020-05-03 | Add system test and docs for Facebook Ads operators (#8503) |
a28c66f23d | 2020-04-30 | [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625) |
992a24ce41 | 2020-04-28 | Split and improve BigQuery example DAG (#8529) |
c1fb28230f | 2020-04-28 | Refactor BigQueryHook dataset operations (#8477) |
e8d0f8feab | 2020-04-26 | Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430) |
37fdfa9775 | 2020-04-26 | [AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442) |
14b22e6ffe | 2020-04-25 | Add hook and operator for Google Cloud Life Sciences (#8481) |
72ddc94d1e | 2020-04-23 | Pass location using parmamter in Dataflow integration (#8382) |
912aa4b423 | 2020-04-23 | Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174) |
57c8c05839 | 2020-04-22 | Use python client in BQ hook create_empty_table/dataset and table_exists (#8377) |
5d3a7eef30 | 2020-04-20 | Allow multiple extra_packages in Dataflow (#8394) |
79c99b1b6a | 2020-04-18 | Added location parameter to BigQueryCheckOperator (#8273) |
79d3f33c1b | 2020-04-17 | Clean up temporary files in Dataflow operators (#8313) |
efcffa323d | 2020-04-16 | Add Dataproc SparkR Example (#8240) |
b198a1fa94 | 2020-04-15 | Create guide for BigQuery operators (#8276) |
2636cc932c | 2020-04-14 | Raise exception when GCP credential doesn't support account impersonation (#8213) |
eee4ebaeeb | 2020-04-14 | Added Facebook Ads Operator #7887 (#8008) |
8cae07ea18 | 2020-04-14 | fixed typo (#8294) |
45c8983306 | 2020-04-13 | Less aggressive eager upgrade of requirements (#8267) |
1fd9ed3840 | 2020-04-13 | Add mypy plugin for decorators. (#8145) |
327b0a9f77 | 2020-04-13 | Added GoogleDisplayVideo360UploadLineItemsOperator (#8216) |
bb5e403a32 | 2020-04-10 | Honor schema type for MySQL to GCS data pre-process (#8090) |
87969a350d | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
3fc89f29f5 | 2020-04-06 | [AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849) |
7ef75d2393 | 2020-04-03 | [AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049) |
ed2bc00576 | 2020-04-02 | Add Google Ads list accounts operator (#8007) |
3808a6206e | 2020-04-01 | Unify Google class/package names (#8033) |
8a02402576 | 2020-03-31 | Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011) |
8e89780071 | 2020-03-31 | Add more refactor steps for providers.google (#8010) |
aae3b8fb27 | 2020-03-31 | Individual package READMEs (#8012) |
779023968f | 2020-03-30 | [AIRFLOW-7075] Operators for storing information from GCS into GA (#7743) |
49abce5217 | 2020-03-30 | Improve system tests for Cloud Build (#8003) |
0f19a930d1 | 2020-03-29 | Remove GKEStartPodOperator when backporting (#7908) |
0e1c238b2f | 2020-03-28 | Get Airflow Variables from GCP Secrets Manager (#7946) |
eb4af4f944 | 2020-03-28 | Make BaseSecretsBackend.build_path generic (#7948) |
01f99426fd | 2020-03-28 | Add download/upload operators for GCS and Google Sheets (#7866) |
892522f8e2 | 2020-03-26 | Change signature of GSheetsHook methods (#7853) |
bfd425157a | 2020-03-26 | Improve idempotency in MLEngineHook.create_model (#7811) |
f9c226343d | 2020-03-26 | Fix CloudSecretsManagerBackend invalid connections_prefix (#7861) |
e3920f12f4 | 2020-03-26 | Improve setUp/tearDown in Cloud Firestore system test (#7862) |
8ba8a7295a | 2020-03-26 | Improve example DAGs for Cloud Memorystore (#7855) |
f7d1a437c1 | 2020-03-26 | Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856) |
beef6c230e | 2020-03-26 | Improve authorization in GCP system tests (#7863) |
5f165f3e42 | 2020-03-26 | [AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869) |
686d7d50bd | 2020-03-25 | Standardize SecretBackend class names (#7846) |
1982c3fdca | 2020-03-24 | Run Dataflow for ML Engine summary in venv (#7809) |
eef87b9953 | 2020-03-23 | [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830) |
529db07b2e | 2020-03-23 | Improve Google PubSub hook publish method (#7831) |
4bde99f132 | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
a001489b59 | 2020-03-23 | Improve example DAG for ML Engine (#7810) |
9e5a8e7f83 | 2020-03-23 | Add call to Super class in 'google' providers (#7823) |
b86bf79bff | 2020-03-23 | Fix typo in GCP credentials_provider's docstring (#7818) |
56c013ce92 | 2020-03-23 | Add missing docstring in BigQueryHook.create_empty_table (#7817) |
426a79847c | 2020-03-23 | Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812) |
cdf1809fce | 2020-03-23 | [AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795) |
27dac00e12 | 2020-03-22 | [AIRFLOW-7099] Improve system test for cloud transfer service (#7794) |
0daf5d729a | 2020-03-22 | Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791) |
c8088c2bd7 | 2020-03-20 | [AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781) |
5106a29314 | 2020-03-20 | [AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748) |
759ce2a80c | 2020-03-20 | [AIRFLOW-6978] Add PubSubPullOperator (#7766) |
6b9b214e4c | 2020-03-20 | [AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692) |
b118916969 | 2020-03-19 | [AIRFLOW-7069] Fix cloudsql system tests (#7770) |
ae854cae5a | 2020-03-19 | [AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756) |
7e1e954d23 | 2020-03-19 | [AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759) |
6e21c139b3 | 2020-03-19 | [AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762) |
ce022a3f72 | 2020-03-19 | [AIRFLOW-XXXX] Add cross-references for operators guide (#7760) |
029c84e552 | 2020-03-18 | [AIRFLOW-5421] Add Presto to GCS transfer operator (#7718) |
63a3102ede | 2020-03-18 | [AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725) |
73305c7bd5 | 2020-03-18 | [AIRFLOW-7081] Remove env variables from GCP guide (#7755) |
60fdbf6d92 | 2020-03-18 | [AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728) |
de7e934ca3 | 2020-03-17 | [AIRFLOW-7079] Remove redundant code for storing template_fields (#7750) |
0de0347b27 | 2020-03-17 | [AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475) |
91557c6f87 | 2020-03-17 | [AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738) |
51161dbd9d | 2020-03-16 | [AIRFLOW-5664] Store timestamps with microseconds precision (#6354) |
2bc020c431 | 2020-03-14 | [AIRFLOW-7055] Verbose logging option for google provider (#7711) |
c997cab42d | 2020-03-13 | [AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630) |
137896f326 | 2020-03-12 | [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685) |
1f77f943d5 | 2020-03-10 | [AIRFLOW-6980] Improve system tests and building providers package (#7615) |
bf9b6b6d70 | 2020-03-09 | [AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664) |
e5130dc9fe | 2020-03-09 | [AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659) |
faf0df4b94 | 2020-03-09 | [AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666) |
42eef38217 | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
b5b9795f04 | 2020-03-07 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624) |
6b65038fb4 | 2020-03-06 | [AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631) |
755fe52249 | 2020-03-05 | [AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535) |
cb2f339116 | 2020-03-04 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609) |
09fea3ce8e | 2020-03-04 | [AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612) |
8230ccc48b | 2020-03-04 | [AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547) |
0d1e3088aa | 2020-03-04 | [AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604) |
ab6bb0012c | 2020-03-03 | [AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607) |
3db4ade3dc | 2020-02-29 | [AIRFLOW-6924] Fix Google DLP operators return types (#7546) |
008b4bab14 | 2020-02-27 | [AIRFLOW-6730] Use total_seconds instead of seconds (#7363) |
bb552b2d9f | 2020-02-25 | [AIRFLOW-6908] Lazy load AirflowException (#7528) |
d1a34246ac | 2020-02-25 | [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322) |
3320e432a1 | 2020-02-24 | [AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517) |
dcf8743521 | 2020-02-24 | [AIRFLOW-6894] Prevent db query in example_dags (#7516) |
4d03e33c11 | 2020-02-22 | [AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456) |
35b9616378 | 2020-02-21 | [AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486) |
aff3a361b4 | 2020-02-20 | [AIRFLOW-6558] Campaign Manager operators for conversions (#7420) |
9cbd7de6d1 | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
5b199cb86b | 2020-02-17 | [AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429) |
2c9345a8e0 | 2020-02-17 | [AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400) |
946bdc23c0 | 2020-02-16 | [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126) |
2381c820c8 | 2020-02-13 | [AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399) |
04c1fefbf2 | 2020-02-03 | [AIRFLOW-6676] added GCSDeleteBucketOperator (#7307) |
a0252748ff | 2020-02-03 | [AIRFLOW-6717] Remove non-existent field from templated_fields (#7340) |
97a429f9d0 | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
9d8d075578 | 2020-02-03 | [AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337) |
cf141506a2 | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
373c6aa4a2 | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
83c037873f | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
057f3ae3a4 | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
ceea293c16 | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
c42a375e79 | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
059eda05f8 | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
f4d3e5e545 | 2020-01-13 | [AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151) |
e7bf8ecb48 | 2020-01-13 | [AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125) |
5b6772cb83 | 2020-01-09 | [AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112) |
4f8592ae8f | 2020-01-08 | [AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046) |
20299473f1 | 2020-01-03 | [AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020) |
18e8cea4e7 | 2020-01-03 | [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007) |
95087af140 | 2019-12-31 | [AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968) |
69629a5a94 | 2019-12-09 | [AIRFLOW-5807] Move SFTP from contrib to providers. (#6464) |
25e9047a4a | 2019-12-09 | [AIRFLOW-6193] Do not use asserts in Airflow main code (#6749) |
ed0a14f321 | 2019-12-09 | [AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734) |
2f2f89c148 | 2019-12-01 | [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701) |
03c870a617 | 2019-11-26 | [AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601) |
5c4cfea8c0 | 2019-11-15 | [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393) |
44a8c37a9a | 2019-11-13 | [AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581) |
d633d3ac44 | 2019-11-13 | [AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371) |
d985c02d9f | 2019-11-05 | [AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497) |
a296cdabdb | 2019-11-04 | [AIRFLOW-5743] Move Google PubSub to providers package (#6476) |
470b2a779d | 2019-10-30 | [AIRFLOW-5741] Move Cloud Natural Language to providers (#6421) |
f2caa451fc | 2019-10-27 | [AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424) |
16d7accb22 | 2019-10-22 | [AIRFLOW-4971] Add Google Display & Video 360 integration (#6170) |
4e661f535d | 2019-10-22 | [AIRFLOW-5379] Add Google Search Ads 360 operators (#6228) |
19e32b4e2c | 2019-10-18 | [AIRFLOW-5656] Rename provider to providers module (#6333) |