Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Support Iceberg table format for dbt Snapshots #1270

Open
3 tasks done
maurofloriano opened this issue Dec 10, 2024 · 4 comments
Open
3 tasks done

[Feature] Support Iceberg table format for dbt Snapshots #1270

maurofloriano opened this issue Dec 10, 2024 · 4 comments
Labels
enhancement New feature or request iceberg

Comments

@maurofloriano
Copy link

Is this your first time submitting a feature request?

  • I have read the expectations for open source contributors
  • I have searched the existing issues, and I could not find an existing issue for this feature
  • I am requesting a straightforward extension of existing dbt-snowflake functionality, rather than a Big Idea better suited to a discussion

Describe the feature

During tests, verified that when trying to create a snapshot via dbt, even passing iceberg configurations, dbt create as simple table instead of creating as iceberg table.

Describe alternatives you've considered

Also add this feature for the flow that creates snapshot.

Who will this benefit?

Whoever is going to use iceberg tables as default in snowflake.

Are you interested in contributing this feature?

No response

Anything else?

No response

@maurofloriano maurofloriano added enhancement New feature or request triage labels Dec 10, 2024
@amychen1776
Copy link

Hello @maurofloriano - I'm curious if you would be able to share why you would want to create dbt snapshots as iceberg table format?

@amychen1776 amychen1776 changed the title [Feature] Snapshots not being created as iceberg tables [Feature] Support Iceberg table format for dbt Snapshots Dec 10, 2024
@maurofloriano
Copy link
Author

Hey! thanks for the reply.

So, on our context, we plan to create anything as iceberg tables. So would be nice to create seeds, snapshots, tables all options that dbt have it, would be interesting in our usecase to make it available for users in iceberg format.

@amychen1776
Copy link

Thanks @maurofloriano! At this time, we don't have plans to support snapshots but I'm very excited to see the community response and have more folks upvote for this feature so that we might add it to the roadmap.

@trouze
Copy link

trouze commented Dec 12, 2024

Hey @maurofloriano !

I had a customer of mine ask about the same possibility- materializing snapshots as iceberg tables. While we get this prioritized on our roadmap, you can take a look at an illustration of some working code that overrides the default snapshot materialization to achieve the same goal. See my gist for details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request iceberg
Projects
None yet
Development

No branches or pull requests

3 participants