Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: vdb_upload example produces warnings about a possible memory leak #1864

Closed
2 tasks done
dagardner-nv opened this issue Aug 24, 2024 · 0 comments · Fixed by #1902
Closed
2 tasks done

[BUG]: vdb_upload example produces warnings about a possible memory leak #1864

dagardner-nv opened this issue Aug 24, 2024 · 0 comments · Fixed by #1902
Assignees
Labels
bug Something isn't working

Comments

@dagardner-nv
Copy link
Contributor

dagardner-nv commented Aug 24, 2024

Version

24.10

Which installation method(s) does this occur on?

Source

Describe the bug.

Issue appears limited to instances when a pdf file is parsed.

====Pipeline Complete====
Total time: 11.54 sec
Pipeline runtime: 7.79 sec
-> Cannot close object, library is destroyed. This may cause a memory leak!
-> Cannot close object, library is destroyed. This may cause a memory leak!
-> Cannot close object, library is destroyed. This may cause a memory leak!
-> Cannot close object, library is destroyed. This may cause a memory leak!
-> Cannot close object, library is destroyed. This may cause a memory leak!

Minimum reproducible example

python examples/llm/main.py vdb_upload pipeline --source_type filesystem --file_source="./tests/tests_data/test.pdf"

Relevant log output

Click here to see error details

====Pipeline Complete====
Total time: 11.54 sec
Pipeline runtime: 7.79 sec
-> Cannot close object, library is destroyed. This may cause a memory leak!
-> Cannot close object, library is destroyed. This may cause a memory leak!
-> Cannot close object, library is destroyed. This may cause a memory leak!
-> Cannot close object, library is destroyed. This may cause a memory leak!
-> Cannot close object, library is destroyed. This may cause a memory leak!

Full env printout

Click here to see environment details

[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

  • I agree to follow Morpheus' Code of Conduct
  • I have searched the open bugs and have found no duplicates for this bug report
@dagardner-nv dagardner-nv added the bug Something isn't working label Aug 24, 2024
@morpheus-bot-test morpheus-bot-test bot moved this from Todo to Review - Ready for Review in Morpheus Boards Sep 20, 2024
@dagardner-nv dagardner-nv self-assigned this Sep 20, 2024
@mdemoret-nv mdemoret-nv added this to the 24.10 - Release milestone Sep 25, 2024
rapids-bot bot pushed a commit that referenced this issue Sep 25, 2024
* Import `pypdfium2` early to ensure the `atexit` registered by `pypdfium2` is invoked after our `after_pipeline` method is.

Closes #1864

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md).
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #1902
@github-project-automation github-project-automation bot moved this from Review - Ready for Review to Done in Morpheus Boards Sep 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants