Skip to content

Commit

Permalink
Added docs for quota project (#6054)
Browse files Browse the repository at this point in the history
## What are you changing in this pull request and why?
<!--
Describe your changes and why you're making them. If related to an open
issue or a pull request on dbt Core or another repository, then link to
them here!

To learn more about the writing conventions used in the dbt Labs docs,
see the [Content style
guide](https://github.com/dbt-labs/docs.getdbt.com/blob/current/contributing/content-style-guide.md).
-->

References dbt-labs/dbt-bigquery#1343 dbt-labs/dbt-bigquery#1344

Adding docs to detail changes in PR dbt-labs/dbt-bigquery#1345

This adds detail about how to override the `quota_project` through the
dbt profile. It also updates the information regarding the execution
project. I believe that the execution project just sets where the BQ job
is created and doesn't actually impact where it's billed from (I could
be wrong on this, but from my testing I can see that the quota project
is set from the environment not from the execution project override
currently detailed in the docs).

## Checklist
- [x] I have reviewed the [Content style
guide](https://github.com/dbt-labs/docs.getdbt.com/blob/current/contributing/content-style-guide.md)
so my content adheres to these guidelines.
- [ ] The topic I'm writing about is for specific dbt version(s) and I
have versioned it according to the [version a whole
page](https://github.com/dbt-labs/docs.getdbt.com/blob/current/contributing/single-sourcing-content.md#adding-a-new-version)
and/or [version a block of
content](https://github.com/dbt-labs/docs.getdbt.com/blob/current/contributing/single-sourcing-content.md#versioning-blocks-of-content)
guidelines.
- [ ] I have added checklist item(s) to this list for anything anything
that needs to happen before this PR is merged, such as "needs technical
review" or "change base branch."
<!--
PRE-RELEASE VERSION OF dbt (if so, uncomment):
- [ ] Add a note to the prerelease version [Migration
Guide](https://github.com/dbt-labs/docs.getdbt.com/tree/current/website/docs/docs/dbt-versions/core-upgrade)
-->
<!-- 
ADDING OR REMOVING PAGES (if so, uncomment):
- [ ] Add/remove page in `website/sidebars.js`
- [ ] Provide a unique filename for new pages
- [ ] Add an entry for deleted pages in `website/vercel.json`
- [ ] Run link testing locally with `npm run build` to update the links
that point to deleted pages
-->

---------

Co-authored-by: Leona B. Campbell <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
  • Loading branch information
3 people authored Dec 18, 2024
1 parent 51d541f commit 9953c37
Showing 1 changed file with 22 additions and 0 deletions.
22 changes: 22 additions & 0 deletions website/docs/docs/core/connect-data-platform/bigquery-setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -388,6 +388,28 @@ my-profile:
execution_project: buck-stops-here-456
```

### Quota project

By default, dbt will use the `quota_project_id` set within the credentials of the account you are using to authenticate to BigQuery.

Optionally, you may specify `quota_project` to bill for query execution instead of the default quota project specified for the account from the environment.

This can sometimes be required when impersonating service accounts that do not have the BigQuery API enabled within the project in which they are defined. Without overriding the quota project, it will fail to connect.

If you choose to set a quota project, the account you use to authenticate must have the `Service Usage Consumer` role on that project.

```yaml
my-profile:
target: dev
outputs:
dev:
type: bigquery
method: oauth
project: abc-123
dataset: my_dataset
quota_project: my-bq-quota-project
```

### Running Python models on Dataproc

import BigQueryDataproc from '/snippets/_bigquery-dataproc.md';
Expand Down

0 comments on commit 9953c37

Please sign in to comment.