Draft: Add config to TaskInstance context

[wseaton]

Description

forwards context from the parsed model config object to the Airflow TaskInstance Context so it is available in callback functions

Related Issue(s)

closes #698

Breaking Change?

not that I'm aware

Checklist

• I have made corresponding changes to the documentation (if required)
• I have added tests that prove my fix is effective or that my feature works

Would like guidance on where you'd like the tests for this, eg. mocked in the operators section or integration.

[netlify]

👷 Deploy Preview for amazing-pothos-a3bca0 processing.

Name	Link
🔨 Latest commit	472287b
🔍 Latest deploy log	https://app.netlify.com/sites/amazing-pothos-a3bca0/deploys/655cb3320814a900085ccd2f

[wseaton]

Getting type check failures because of pre python 3.9 available type hint syntax that is being used, like dict[str, Any]. Do we want to fix that in other parts of the codebase?

[tatiana]

Thanks for working on this!

Getting type check failures because of pre python 3.9 available type hint syntax that is being used, like dict[str, Any]. Do we want to fix that in other parts of the codebase?

@wseaton it's possible to avoid this exception in previous versions of Python by using from __future__ import annotations.

I'm changing this PR to draft mode - please, move it back to a non-draft PR once the branch is rebased and the tests are passing.

[pankajkoti]

hi @wseaton are you still working on this PR or could we close this?

[tatiana]

@wseaton, we find this very useful; please, if you have a chance, we'd love to see this work resumed!

For now, we're starting to close stale PRs - but please let us know if we can help you get this work to the finishing line.

Feel free to reopen or create a new PR.

[wseaton]

Thanks @tatiana, to be honest I actually forget why I needed this. Do you have any examples you can share publicly of how this would be useful? Perhaps I can pick it back up.

Edit: My linked issue shows why: #698 (comment), there is DBT specific DAG metadata that would be useful to have available to route via webhooks.

[linchun3]

Sorry for hijacking this, I have a use case for this feature and would like to contribute.

I have created a draft PR to implement this feature :)