All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, adheres to Semantic Versioning, and is generated by Changie.
- Fix DBT_BQ_MONITORING_GCP_PROJECTS being required while it should not for region mode
-
Fix bi engine statistics structure not consistent between audit logs & information schema
-
Fix materialized_as_view_if_explicit_projects macro as not working as intended in region mode
-
Protect get_query_comment against potential undefined
- Improve the documentation regarding combining audit logs with information schema jobs data
- Small changes to fix compatibility with SQLMesh
- Allow to combine audit logs and information schema jobs table to have the best of both worlds
- Support for audit logs (#61)
- Add client type support to breakdown by type of workload (#68)
-
Fix stg_partitions_monitoring that wasn't exhaustive because of a restriction on partition expiration based tables (#79)
-
Restrain stg_partitions_monitoring to partitioned tables
- Rework models to use
project_idprefix if possible and useephemeralif relevant (#74)
- Update Google base models based on latest documentation parsing (#71)
- New compute optimization oriented views (#59)
- Add BI engine usage monitoring (#58)
- Add reservation_usage_per_minute (#57)
- Fix compute cost per minute that would override latest hour because it is leveraging insert_overwrite.
- Fix lookback for compute billing and make it customizable via
lookback_incremental_billing_window_daysvar
-
Add storage costs to daily_spend when using GCP cost export
-
Add compute_cost_per_minute for precise compute cost tracking
- Add equality on incremental models to avoid cases where hours could be skipped
- SAFE_CAST option_value to avoid potential cast errors
-
Fix information_schema_partition failing when schema isn't in the same gcp project as execution project
-
Add lookback for 3 days on gcp billing export usage (#44)
- Clean up log in get_query_comment"
-
Migrate in another repo documentation parser to reduce the package size from useless files
- clean "No datasets found in the project list" log (#35)
- Add partition_expiration_days to partition & move to view the partitions_monitoring model as it is just adding computed fields on stg_partitions_monitoring
-
Fixes queries related datamart that were storing running/pending jobs thus returning partial numbers
-
Fix is_incremental_run that wasn't working and replaced with a macro to inline proper incremental behavior
-
Bugs on macros copy_partition / gcp billing export
- Add GCP billing export support
-
partition expiration is now configurable
-
Leverage copy_partitions by default (but configurable as well)
- Add CI testing
- rename macro to workaround a <1.6 bug ([#26](https://github.com/bqbooster/dbt-bigquery-monitoring/issues/26))
- Fix the version defined in get_query_comment macro ([#19](https://github.com/bqbooster/dbt-bigquery-monitoring/issues/19))
- Fix the name of the dbt_bigquery_monitoring_options model ([#17](https://github.com/bqbooster/dbt-bigquery-monitoring/issues/17))
- new partitions monitoring model
- Fix dataset based google models such as partitions
- Update google models, add new dataset with costs and clean up (#0)
- Add a model with properties (#0)
- Add missing YML for billing models (#0)
- Fix information_schema_schemata_links model information (#0)
- Fix YML model name misaligned with information schema dbt models (#0)
- Add ephemeral models for all Google metadata tables (along generation script in /documentation_parser)
- Add the "region mode" to avoid listing explicitly GCP projects
- Uniformize fields to count queries to query_count and improve the dbt docs (#0)
- fix storage_with_cost.yml (#0)
- Fix the incremental tables not working as intended (#1)