Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CT-797] Add Iceberg, delta support onto dbt-spark (docker images) #382

Closed
nssalian opened this issue Jul 3, 2022 · 2 comments
Closed
Assignees
Labels
help_wanted Extra attention is needed Stale tech_debt

Comments

@nssalian
Copy link
Contributor

nssalian commented Jul 3, 2022

Describe the feature

Currently, the dbt-spark docker image is configured to include only Apache Hudi jars and Hudi Spark extensions.
It would be valuable to add support for Delta and Iceberg so the community can use the different formats.

Solution: Adding the support into the conf file and making sure the tests work correctly

Who will this benefit?

Users who wish to use the Delta and Iceberg without having to separately add binaries and add extensions.

Are you interested in contributing this feature?

I can add a PR to resolve this.

@nssalian nssalian added enhancement New feature or request triage labels Jul 3, 2022
@nssalian nssalian self-assigned this Jul 3, 2022
@github-actions github-actions bot changed the title Add Iceberg, delta support onto dbt-spark [CT-797] Add Iceberg, delta support onto dbt-spark Jul 3, 2022
@jtcohen6 jtcohen6 added tech_debt and removed enhancement New feature or request triage labels Jul 5, 2022
@jtcohen6
Copy link
Contributor

jtcohen6 commented Jul 5, 2022

Thanks for opening @nssalian! Re-labeling as tech_debt since the core functionality for OSS Delta + Hudi support is in place (and extension Iceberg as described in #294). We want the ability to actually test that functionality in CI, which requires a properly configured Docker image.

@Fleid Fleid changed the title [CT-797] Add Iceberg, delta support onto dbt-spark [CT-797] Add Iceberg, delta support onto dbt-spark (docker images) Dec 9, 2022
@Fleid Fleid added the help_wanted Extra attention is needed label Dec 9, 2022
@github-actions
Copy link
Contributor

github-actions bot commented Jun 7, 2023

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue, or it will be closed in 7 days.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help_wanted Extra attention is needed Stale tech_debt
Projects
None yet
Development

No branches or pull requests

3 participants