ADAP-1051 - Temp Table Drop Fix

[vinit2107]

resolves #1036
resolves #1051

Problem

Temp tables created by DBT in BigQuery in incremental strategy were not dropped after successful execution.

Solution

I have added handling for two scenarios:

1. Drop the temp table after creation
2. Ability to provide which dataset the temp table will be materialized + drop after execution

Checklist

• I have read the contributing guide and understand what's expected of me
• I have run this code in development and it appears to resolve the stated issue
• This PR includes tests, or tests are not required/relevant for this PR
• This PR has no interface changes (e.g. macros, cli, logs, json artifacts, config files, adapter interface, etc)

[cla-bot]

Thanks for your pull request, and welcome to our community! We require contributors to sign our Contributor License Agreement and we don't seem to have your signature on file. Check out this article for more information on why we have a CLA.

In order for us to review and merge your code, please submit the Individual Contributor License Agreement form attached above above. If you have questions about the CLA, or if you believe you've received this message in error, please reach out through a comment on this PR.

CLA has not been signed by users: @vinit2107

[vinit2107]

Thanks for your pull request, and welcome to our community! We require contributors to sign our Contributor License Agreement and we don't seem to have your signature on file. Check out this article for more information on why we have a CLA.

In order for us to review and merge your code, please submit the Individual Contributor License Agreement form attached above above. If you have questions about the CLA, or if you believe you've received this message in error, please reach out through a comment on this PR.

CLA has not been signed by users: @vinit2107

I have signed the CLA. Please let me know if I need to do anything else.

[dbeatty10]

This is looking good so far @vinit2107 !

I made two code suggestions to address and then we can queue it up for review by an engineer.

[vinit2107]

Thanks @dbeatty10 for your input 👍🏻 I have made the recommended changes.

[VersusFacit]

Hey @vinit2107 , thank you so much for this contribution. We had some time to assess this one and I think it looks great. I'm really happy we have this fix as opposed to one that just adds another flag on top of the already existing hours_to_expiration flag. This is all around great news. Thanks to you and Doug for getting this one in a well tested place.

I'll have this merged on Monday :)