Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improvement]: Candidates for expired snapshot timestamp need to be adjusted #3322

Open
3 tasks done
XBaith opened this issue Nov 4, 2024 · 0 comments
Open
3 tasks done

Comments

@XBaith
Copy link
Contributor

XBaith commented Nov 4, 2024

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

I've had users in production mention that orphaned files are not being cleaned up properly.

Upon further inspection it was found that it was because the historical snapshots were not being deleted as expected, and the reason they were not being deleted was because the table contained snapshots that were written by flink, but the table was no longer being consistently written to by flink.

So the most recent snapshot written by flink will not be cleaned up by amoro, even if it is much earlier than the set snapshot retention time.

How should we improve?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Subtasks

No response

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant