Skip to content
This repository has been archived by the owner on Apr 30, 2024. It is now read-only.

Dbt pipline #2

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Dbt pipline #2

wants to merge 2 commits into from

Conversation

djagoda881
Copy link
Contributor

Added action that tests dbt models and runs them.

Course of action:

  • Definition of env var needed for profiles.yml file. NESSO_USER as the schema name in the DB and DB_TOKEN as the DB access token
  • Steps Package installation, Configuration of dbt profiles, dbt package installltion are used to set up the test environment
  • Step dbt target setup is used to switch to the main branch to create the manifest.json file there by using dbt compile. Then I change the branch to the feature branch and copy the manifest.json file outside the target/ directory so that it won't be overwritten because it will be used to detect changes between branches. Running dbt compile updates the target/manifest.json file with the latest changes on the feature branch.
  • The last step runs tests and models based on comparing the change between target/manifest.json and manifest.json files so we can detect differences between models

@djagoda881 djagoda881 requested a review from trymzet June 6, 2023 08:42
@djagoda881 djagoda881 marked this pull request as draft June 6, 2023 09:40
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant