Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark: Add distribution mode not respected for CTAS/RTAS before 3.5.0 #9439

Merged
merged 1 commit into from
Jan 18, 2024

Conversation

manuzhang
Copy link
Contributor

@manuzhang manuzhang commented Jan 8, 2024

This fixes #8887

@github-actions github-actions bot added the docs label Jan 8, 2024
@manuzhang manuzhang force-pushed the distribution_ctas_doc branch from 8ee7bbe to ce3b027 Compare January 8, 2024 16:45
@manuzhang manuzhang changed the title Docs: Add distribution mode not respected before Spark 3.5.0 Docs: Add distribution mode not respected for CTAS/RTAS before Spark 3.5.0 Jan 8, 2024
@manuzhang
Copy link
Contributor Author

@nastra please help review.

@manuzhang manuzhang force-pushed the distribution_ctas_doc branch from ce3b027 to a47688b Compare January 18, 2024 10:41
@manuzhang manuzhang changed the title Docs: Add distribution mode not respected for CTAS/RTAS before Spark 3.5.0 Spark: Add distribution mode not respected for CTAS/RTAS before 3.5.0 Jan 18, 2024
@github-actions github-actions bot added the spark label Jan 18, 2024
@manuzhang manuzhang force-pushed the distribution_ctas_doc branch from a47688b to 58b5709 Compare January 18, 2024 10:44
@manuzhang manuzhang force-pushed the distribution_ctas_doc branch from 58b5709 to 85187f5 Compare January 18, 2024 15:00
@manuzhang manuzhang force-pushed the distribution_ctas_doc branch from 85187f5 to 414bdfc Compare January 18, 2024 15:42
@nastra
Copy link
Contributor

nastra commented Jan 18, 2024

thanks @manuzhang for getting this done

@nastra nastra merged commit 057f887 into apache:main Jan 18, 2024
31 checks passed
geruh pushed a commit to geruh/iceberg that referenced this pull request Jan 26, 2024
adnanhemani pushed a commit to adnanhemani/iceberg that referenced this pull request Jan 30, 2024
devangjhabakh pushed a commit to cdouglas/iceberg that referenced this pull request Apr 22, 2024
@manuzhang manuzhang deleted the distribution_ctas_doc branch June 4, 2024 11:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Document that distribution modes do not work with DataFrameWriterV2 API Create statements [Documentation]
2 participants