Inference error

[lucasjinreal]

return F.conv2d(input, weight, bias, self.stride,

RuntimeError: cuDNN error: CUDNN_STATUS_NOT_INITIALIZED

why it got this error?

[zhanwenchen]

Likely an OOM error

[lucasjinreal]

No, I tried 7b as well on V100 32G, same error.

Also, I found even print(pixel_values) would trigger this error, why

[zhanwenchen]

No, I tried 7b as well on V100 32G, same error.

Also, I found even print(pixel_values) would trigger this error, why

Sounds like a cpu-gpu communication issue. What's your nvidia-driver-xxx number?

[lucasjinreal]

Hi, I using your load_pllava loaded the model it not can inference, see my newest issue, but the result is wrong.

I htink pllave can not be loaded with PLLava.from_pretrained.