Viadot 0.3.2

Fixed

• fixed an issue with schema info within CheckColumnOrder

Viadot 0.3.1

Changed

-ADLSToAzureSQL - added remove_tab parameter to remove uncessery tab separators from data.

Fixed

• fixed an issue with return df within CheckColumnOrder class.

Viadot 0.3.0

Added

• new source SAPRFC for connecting with SAP using the pyRFC library (requires pyrfc as well as the SAP NW RFC library that can be downloaded here
• new source DuckDB for connecting with the DuckDB database
• new task SAPRFCToDF for loading data from SAP to a pandas DataFrame
• new tasks, DuckDBQuery and DuckDBCreateTableFromParquet, for interacting with DuckDB
• new flow SAPToDuckDB for moving data from SAP to DuckDB
• Added CheckColumnOrder task
• C4C connection with url and report_url documentation
  -SQLIteInsert check if DataFrame is empty or object is not a DataFrame
• KeyVault support in SharepointToDF task
• KeyVault support in CloudForCustomers tasks

Changed

• pinned Prefect version to 0.15.11
• df_to_csv now creates dirs if they don't exist
• ADLSToAzureSQL - when data in csv coulmns has unnecessary "\t" then removes them

Fixed

• fixed an issue with duckdb calls seeing initial db snapshot instead of the updated state (#282)
• C4C connection with url and report_url optimization
• column mapper in C4C source

Viadot 0.2.15

Added

• new option to ADLSToAzureSQL Flow - if_exists="delete"
• SQL source: create_table() already handles if_exists; now it handles a new option for if_exists()
• C4CToDF and C4CReportToDF tasks are provided as a class instead of function

Fixed

• Appending issue within CloudForCustomers source

Viadot 0.2.14

[0.2.14]

Fixed

• authorization issue within CloudForCustomers source

Viadot 0.2.13

Added

• Added support for file path to CloudForCustomersReportToADLS flow

Fixed

• Supermetrics source: to_df() now correctly handles if_empty in case of empty results

Changed

• Sharepoint and CloudForCustomers sources will now provide an informative CredentialError which is also raised early. This will make issues with input credentials immediately clear to the user.
• Removed set_key_value from CloudForCustomersReportToADLS flow

Viadot 0.2.12

Added

• Added Sharepoint source
• Added SharepointToDF task
• Added SharepointToADLS flow
• Added CloudForCustomers source
• Added c4c_report_to_df taks
• Added def c4c_to_df task
• Added CloudForCustomersReportToADLS flow
• Added df_to_csv task to task_utils.py
• Added df_to_parquet task to task_utils.py
• Added dtypes_to_json task to task_utils.py

Viadot 0.2.11

Fixed

• ADLSToAzureSQL - fixed path to csv issue.
• SupermetricsToADLS - fixed local json path issue.

Viadot 0.2.10

Release due to CI/CD error

Viadot 0.2.9

Release due to CI/CD error