Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trouble running code #3

Open
Ni2002ka opened this issue May 12, 2024 · 0 comments
Open

Trouble running code #3

Ni2002ka opened this issue May 12, 2024 · 0 comments

Comments

@Ni2002ka
Copy link

Ni2002ka commented May 12, 2024

When trying to debug compute_sharded_comparison_test.py I get the following error:

"RuntimeError: CUDA error: invalid device ordinal"

After a minute the following message shows up and the process hangs:
"GPU 0 loaded model."

I also tried following the run instructions in the readme, but in both cases, the process hangs after the gpus load the model.

The problem persists when running on a single gpu vs multiple gpus.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant