Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check for missing projects by parsing the dependencies.yml file. #12

Open
nicholasyager opened this issue Jul 19, 2023 · 2 comments
Open
Assignees
Labels
enhancement New feature or request

Comments

@nicholasyager
Copy link
Owner

As part of dbt Lab's new multi-project deployment functionality in dbt Cloud, they are using a new config file, called dependencies.yml to track project dependencies. We should be leveraging this file to check for missing projects during injection.

@nicholasyager nicholasyager added the enhancement New feature or request label Jul 19, 2023
@nicholasyager nicholasyager self-assigned this Jul 19, 2023
@nicholasyager nicholasyager modified the milestones: v0.3.0, v0.2.0 Jul 19, 2023
@nicholasyager nicholasyager modified the milestones: v0.2.0, 0.2.1 Aug 29, 2023
@nicholasyager nicholasyager removed this from the v0.2.1 milestone Nov 11, 2023
@geoHeil
Copy link

geoHeil commented Feb 29, 2024

you mean instead of the extra loom config? Or in addition?

@nicholasyager nicholasyager modified the milestones: 0.5.1, 0.5.2 Apr 19, 2024
@nicholasyager nicholasyager modified the milestones: 0.5.3, 0.5.4 May 9, 2024
@nicholasyager nicholasyager modified the milestones: 0.5.4, 0.5.5 Jun 1, 2024
@radium226
Copy link

Hello!

First of all, thanks a lot for this amazing project which is very (very!) helpful.

For now, I dynamically generate a config file by parsing the dependencies.yml and inject it using the DBT_LOOM_CONFIG env var.

But it's true that it could be better to use directly the dependencies.yml and either an entry in the config file to setup the S3 bucket and the pattern how to access the file.

I was thinking of something like:

dependencies:
  type: s3
  config:
    bucket_name: ${DBT_STATES_S3_BUCKET}
    object_pattern states/%{name}/manifest.json

Is that the kind of thing you had in mind?

@nicholasyager nicholasyager removed this from the 0.5.7 milestone Oct 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants