Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: possible out of memory error #5413

Closed
wants to merge 3 commits into from

Conversation

klopfdreh
Copy link
Contributor

@klopfdreh klopfdreh commented Jul 24, 2023

Possibly fixes: #5409

As of https://dataschool.com/how-to-teach-people-sql/difference-between-where-and-on-in-sql/ some databases might join before filter which might cause out of memory exceptions because all task manifests are load.

Different SQL languages may have different query plans based on filtering in the ON clause vs the WHERE clause, so test the performance on your database

@klopfdreh
Copy link
Contributor Author

Edit: This might only optimize the performance on DB server but not cause the JVM to raise an OutOfMemoryError.

I try to figure out what's the real cause and if I find something I am going to push it into this branch. klopfdreh:fix/outofmemory

@corneil corneil added the status/on-hold For various reasons is on hold label Jul 24, 2023
@corneil
Copy link
Contributor

corneil commented Jul 24, 2023

We can revisted once we have done testing on the support for Boot 3 workloads with new Spring Batch and Spring Cloud Task schemas.

@klopfdreh
Copy link
Contributor Author

We can revisted once we have done testing on the support for Boot 3 workloads with new Spring Batch and Spring Cloud Task schemas.

Thanks a lot! 👍

@klopfdreh
Copy link
Contributor Author

@corneil the out of memory issue did not happened with 2.11.0 anymore. I am going to close this PR as it only changes the SQLs slightly.

@klopfdreh klopfdreh closed this Oct 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status/on-hold For various reasons is on hold
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Out of Memory Exception while clicking on "Job Execution Ids" in a task
2 participants