Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Postgres to YTsaurus - is multi key operations transactional? #106

Open
Arustinal opened this issue Nov 15, 2024 · 1 comment
Open

Postgres to YTsaurus - is multi key operations transactional? #106

Arustinal opened this issue Nov 15, 2024 · 1 comment
Labels
question Further information is requested

Comments

@Arustinal
Copy link

Is transfer guarantee that let's say 2 updates in single transaction on PostgreSQL side will be applied in one dyntable YT transaction?

@laskoviymishka
Copy link
Contributor

The short answer to your question is that PostgreSQL transactions do map to YT transactions with some restriction. In dynamic tables, a single transaction is limited to 100,000 rows. For transactions exceeding 90,000 rows (due to internal considerations, to avoid OOM-s on tablet agent side, since agent hold hole transaction in memory), we split them into smaller chunks. However, transactions smaller than this threshold are preserved as they are from the source system. I will look for relevant tests or documentation to confirm this behavior.

@laskoviymishka laskoviymishka added the question Further information is requested label Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants