Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: pyarrow-hotfix is still required even though pyarrow>=14.01 #1691

Closed
2 tasks done
mdemoret-nv opened this issue May 7, 2024 · 0 comments · Fixed by #1692
Closed
2 tasks done

[BUG]: pyarrow-hotfix is still required even though pyarrow>=14.01 #1691

mdemoret-nv opened this issue May 7, 2024 · 0 comments · Fixed by #1692
Labels
bug Something isn't working

Comments

@mdemoret-nv
Copy link
Contributor

Version

24.03

Which installation method(s) does this occur on?

Docker, Conda, Source, Kubernetes

Describe the bug.

After upgrading to cuDF 24.02 in PR #1468, the dependency on pyarrow_hotfix was removed from dependencies.yaml and meta.yaml but __init__.py still calls import pyarrow_hotfix. This causes the runtime container as well as the conda build to fail.

Minimum reproducible example

Run the following:

./docker/build_conda_packages.sh morpheus

And you will see the following in the log:

Relevant log output

Click here to see error details

File "/opt/conda/conda-bld/morpheus-split-24.03.00a/_h_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pl/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 992, in _find_and_load_unlocked
File "", line 241, in _call_with_frames_removed
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 992, in _find_and_load_unlocked
File "", line 241, in _call_with_frames_removed
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/opt/conda/conda-bld/morpheus-split-24.03.00a/work/build-conda/morpheus/init.py", line 21, in
import pyarrow_hotfix
ModuleNotFoundError: No module named 'pyarrow_hotfix'

Full env printout

Click here to see environment details

[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

  • I agree to follow Morpheus' Code of Conduct
  • I have searched the open bugs and have found no duplicates for this bug report
@mdemoret-nv mdemoret-nv added the bug Something isn't working label May 7, 2024
@rapids-bot rapids-bot bot closed this as completed in #1692 May 9, 2024
rapids-bot bot pushed a commit that referenced this issue May 9, 2024
- Remove `pyarrow_hotfix` import

Closes #1691 

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md).
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - Eli Fajardo (https://github.com/efajardo-nv)
  - Michael Demoret (https://github.com/mdemoret-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #1692
@github-project-automation github-project-automation bot moved this from Todo to Done in Morpheus Boards May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants