Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix : patch snowflake driver for memory fix #6330

Closed
wants to merge 1 commit into from
Closed

fix : patch snowflake driver for memory fix #6330

wants to merge 1 commit into from

Conversation

k-anshul
Copy link
Member

@k-anshul k-anshul commented Dec 24, 2024 •
edited
Loading

This relates to #6324
Forgot to patch the snowflake driver after upgrading :(

@k-anshul k-anshul self-assigned this Dec 24, 2024
@k-anshul
Copy link
Member Author

Thanks for the review.
Well as it turns out the above issue does not have anything to do with the leaks that we are seeing. We do not hit that code path. We do not decode the arrow records and directly pass it to parquet converter.
But it seems likely that leak is somewhere in the snowflake code path since projects using snowflake connector seems to be getting OOMs. I will take a deeper look at the library.

@k-anshul k-anshul closed this Dec 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@pjain1 pjain1 pjain1 approved these changes

@nishantmonu51 nishantmonu51 Awaiting requested review from nishantmonu51

Assignees

@k-anshul k-anshul

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@k-anshul @pjain1