Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable Docs DAG in CI leveraging existing CI connections #1428

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

pankajkoti
Copy link
Contributor

@pankajkoti pankajkoti commented Dec 26, 2024

It seems that the dbt docs DAG in our example DAGs suite was silently failing to run because the specified connections in the DAG were not present in our CI environment. I am removing the connection checks, allowing the previously skipped tasks to execute even when the remote Airflow connections are unavailable. Additionally, I’ve updated the DAG to use our existing CI credentials and Airflow connections, as well as updated the bucket name to the ones I created in our object stores. This change will help catch issues like #1420 earlier. While fix #1422 has already addressed #1420, this PR will now validate that the fix is functioning as expected.

closes: #1420

Copy link

netlify bot commented Dec 26, 2024

Deploy Preview for sunny-pastelito-5ecb04 canceled.

Name Link
🔨 Latest commit d44d5bb
🔍 Latest deploy log https://app.netlify.com/sites/sunny-pastelito-5ecb04/deploys/676d0439fde2de0008c7d5d3

Copy link

cloudflare-workers-and-pages bot commented Dec 26, 2024

Deploying astronomer-cosmos with  Cloudflare Pages  Cloudflare Pages

Latest commit: d44d5bb
Status: ✅  Deploy successful!
Preview URL: https://bce3e21c.astronomer-cosmos.pages.dev
Branch Preview URL: https://enable-docs-dag.astronomer-cosmos.pages.dev

View logs

@pankajkoti pankajkoti marked this pull request as ready for review December 26, 2024 07:00
@dosubot dosubot bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Dec 26, 2024
@dosubot dosubot bot added the area:ci Related to CI, Github Actions, or other continuous integration tools label Dec 26, 2024
@pankajkoti pankajkoti requested a review from tatiana December 26, 2024 07:00
@pankajkoti
Copy link
Contributor Author

Action run https://github.com/astronomer/astronomer-cosmos/actions/runs/12500718837/job/34877247783?pr=1428 before merging and rebasing PR #1422 here shows that we now are running the example DAG for docs upload test in our CI with this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:ci Related to CI, Github Actions, or other continuous integration tools size:M This PR changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug] DbtDocsGCSLocalOperator.upload_to_cloud_storage() got an unexpected keyword argument 'context'
1 participant