Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark: backport #8656 and update docs #9512

Merged
merged 3 commits into from
Jan 19, 2024
Merged

Conversation

ajantha-bhat
Copy link
Member

@ajantha-bhat ajantha-bhat commented Jan 18, 2024

This is needed for 1.5.0 release as it removed the deprecated fields.

* <p>The procedure removes the carry-over rows by default. If you want to keep them, you can set
* "remove_carryovers" to be false in the options.
* <p>The procedure always removes the carry-over rows. Please query {@link SparkChangelogTable}
* instead for the use cases doesn't remove carry-over rows.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please query {@link SparkChangelogTable} instead when carry-over rows are not required

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rows are not required

I guess you mean "rows are required". I have updated.

@nastra nastra merged commit 1e3b38e into apache:main Jan 19, 2024
31 checks passed
geruh pushed a commit to geruh/iceberg that referenced this pull request Jan 26, 2024
adnanhemani pushed a commit to adnanhemani/iceberg that referenced this pull request Jan 30, 2024
devangjhabakh pushed a commit to cdouglas/iceberg that referenced this pull request Apr 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants