Releases: astronomer/astronomer-cosmos
v1.8.0a4
Same as v1.8.0a3 and additionally the below changes:
New Features
- Support rendering tasks with non-ASCII characters by @t0momi219 in #1278 Read more
- Add warning callback on source freshness by @pankajastro in #1400 Read more
- Add Oracle Profile mapping by @slords and @pankajkoti in #1190 and #1404
Bug Fixes
Enhancements
- Add logging of stdout to dbt graph run_command by @KarolGongola in #1390
- Save tasks map as DbtToAirflowConverter property by @internetcoffeephone and @hheemskerk in #1362
Docs
- Add security policy by @tatiana, @chaosmaw and @lzdanski in # 1385
- Mention in documentation that the callback functionality is supported in
ExecutionMode.VIRTUALENV
by @pankajkoti in #1401
Others
- Unpin dbt-databricks version by @pankajastro in #1409
- Fix source resource type tests by @pankajastro in #1405
- Increase performance tests models by @tatiana in #1403
- Drop running 1000 models in the CI by @pankajkoti in #1411
- Fix releasing package to PyPI by @tatiana in #1396
v1.8.0a3
New Features
- Support customizing Airflow operator arguments per dbt node by @wornjs in #1339. More information.
- Support uploading dbt artifacts to remote cloud storages via callback by @pankajkoti in #1389. Read more.
- Add support to
TestBehavior.BUILD
by @tatiana in #1377. Documentation. - Add support for the "at" operator when using
LoadMode.DBT_MANIFEST
orCUSTOM
by @benjy44 in #1372 - Add dbt clone operator by @pankajastro in #1326, as documented in here.
Bug Fixes
- Fix the mock value of port in
TrinoBaseProfileMapping
to be an integer by @dwolfeu #1322 - Fix access to the
dbt docs
menu item outside of Astro cloud by @tatiana in #1312 - Add missing
DbtSourceGcpCloudRunJobOperator
in modulecosmos.operators.gcp_cloud_run_job
by @anai-s in #1290 - Support building
DbtDag
without setting paths inProjectConfig
by @tatiana in #1307 - Fix parsing dbt ls outputs that contain JSONs that are not dbt nodes by @tatiana in #1296
Enhancements
-
Improve dbt command execution logs to troubleshoot
None
values by @tatiana in #1392
Docs -
Remove extra ` char from docs by @pankajastro in #1345
-
Add limitation about copying target dir files to remote by @pankajkoti in #1305
-
Generalise example from README by @ReadytoRocc in #1311
Others
- Restore Jaffle Shop so that
basic_cosmos_dag
works as documented by @tatiana in #1374 - Remove Pytest durations from tests scripts by @tatiana in #1383
- Remove typing-extensions as dependency by @pankajastro in #1381
- Pin dbt-databricks version to < 1.9 by @pankajastro in #1376
- Refactor
dbt-sqlite
tests to usedbt-postgres
by @pankajastro in #1366 - Remove 'dbt-core<1.8.9' pin by @tatiana in #1371
- Remove dependency
eval_type_backport
by @tatiana in #1370 - Enable kubernetes tests for dbt>=1.8 by @pankajastro #1364
- CI Workaround: Pin dbt-core, Disable SQLite Tests, and Correctly Ignore Clone Test to Pass CI by @pankajastro in #1337
- Enable Azure task in the remote store manifest example DAG by @pankajkoti in #1333
- Enable GCP remote manifest task by @pankajastro in #1332
- Add exempt label option in GH action stale job by @pankajastro in #1328
- Add integration test for source node rendering by @pankajastro in #1327
- Fix vulnerability issue on docs dependency by @tatiana in #1313
- Add postgres pod status check for k8s tests in CI by @pankajkoti in #1320
- [CI] Reduce the amount taking to run tests in the CI from 5h to 11min by @tatiana in #1297
- Enable secret detection precommit check by @pankajastro in #1302
- Fix security vulnerability, by not pinning Airflow 2.10.0 by @tatiana in #1298
- Fix Netlify build timeouts by @tatiana in #1294
- Add stalebot to label/close stale PRs and issues by @tatiana in #1288
- Pre-commit hook updates in #1394, #1373, #1358, #1340, #1331, #1314, #1301
Closes: #1193
v1.8.0a2
Creating this release from branch fix-logging-run-command to support troubleshooting user issues.
v1.8.0a1
Creating this release from branch fix-logging-run-command, to support troubleshooting user issue.
v1.5.0rc2
v1.7.1
Bug fixes
- Fix
DbtVirtualenvBaseOperator
to use correct virtualenv Python path by @kesompochy in #1252 - Fix displaying dbt docs as menu item in Astro by @tatiana in #1280
- Fix: Replace login by user for clickhouse profile by @petershenri in #1255
Enhancements
- Improve dbt Docs Hosting Debugging -- Update dbt_docs_not_set_up.html by @johnmcochran in #1250
- Minor refactor on VirtualenvOperators & add test for PR #1253 by @tatiana in #1286
Docs
- Add Welcome Section and "What Is Cosmos" Blurb to Home Page by @cmarteepants and @yanmastin-astro in #1251
- Update the URL for sample dbt docs hosted in Astronomer S3 bucket by @pankajkoti in #1283
- Add dedicated scarf tracking pixel to readme by @cmarteepants in #1256
Others
- Update
CODEOWNERS
to track all files by @pankajkoti in #1284 - Fix release after the
raw
rst directive was disabled in PyPI by @tatiana in #1282 - Update issue template
bug.yml
- cosmos version update in the dropdown by @pankajkoti in #1275 - Pre-commit hook updates in #1285, #1274, #1254, #1244
v1.7.1a3
v1.7.1a2
v1.7.1a1
v1.7.0
New Features
-
Support using
DatasetAlias
and fix orphaning unreferenced dataset by @tatiana in #1217 #1240Documentation: https://astronomer.github.io/astronomer-cosmos/configuration/scheduling.html#data-aware-scheduling
-
Add GCP_CLOUD_RUN_JOB execution mode by @ags-de #1153
Learn more about it: https://astronomer.github.io/astronomer-cosmos/getting_started/gcp-cloud-run-job.html
-
Introduction of experimental support to run dbt BQ models using Airflow deferrable operators by @pankajkoti @pankajastro @tatiana in #1224 #1230.
This is the first step in the journey of running dbt resources with native Airflow, and we would appreciate feedback from the community.
For more information, check the documentation: https://astronomer.github.io/astronomer-cosmos/getting_started/execution-modes.html#airflow-async-experimental
This work has been inspired by the talk "Airflow at Monzo: Evolving our data platform as the bank scales" by
@jonathanrainer @ed-sparkes given at Airflow Summit 2023: https://airflowsummit.org/sessions/2023/airflow-at-monzo-evolving-our-data-platform-as-the-bank-scales/.
Enhancements
- Create single virtualenv when
DbtVirtualenvBaseOperator
hasvirtualenv_dir=None
andis_virtualenv_dir_temporary=True
by @kesompochy in #1200 - Consistently handle build and imports in
cosmos/__init__.py
by @tatiana in #1215 - Add enum constants to init for direct import by @fabiomx in #1184
Bug fixes
- URL encode dataset names to support multibyte characters by @t0momi219 in #1198
- Fix invalid argument (
full_refresh
) passed to DbtTestAwsEksOperator (and others) by @johnhoran in #1175 - Fix
printer_width
arg type inDbtProfileConfigVars
by @jessicaschueler in #1191 - Fix task owner fallback by @jmaicher in #1195
Docs
- Add scarf to readme and docs for website analytics by @cmarteepants in #1221
- Add
virtualenv_dir
param toExecutionConfig
docs by @pankajkoti in #1173 - Give credits to @LennartKloppenburg in CHANGELOG.rst by @tatiana #1174
- Refactor docs for async mode execution by @pankajkoti in #1241
Others
- Remove PR branch added for testing a change in CI in #1224 by @pankajkoti in #1233
- Fix CI wrt broken coverage upload artifact @pankajkoti in #1210
- Fix CI issues - Upgrade actions/upload-artifact & actions/download-artifact to v4 and set min version for packaging by @pankajkoti in #1208
- Resolve CI failures for Apache Airflow 2.7 jobs by @pankajkoti in #1182
- CI: Update GCP manifest file path based on new secret update by @pankajkoti in #1237
- Pre-commit hook updates in #1176 #1186, #1186, #1201, #1219, #1231