Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUGs in training #10

Open
romeosgood opened this issue Jul 11, 2022 · 2 comments
Open

BUGs in training #10

romeosgood opened this issue Jul 11, 2022 · 2 comments

Comments

@romeosgood
Copy link

Hello, thanks for this amazing work.

However, I met several problems on reproduction and training.

  1. When I try to reproduce this work, the best result of 3D detection is [24.5, 18.4, 15.7] which is far behind your result.
  2. When I try to replace dla34 with other backbone, such as hrnet, the loss is not convergent.
  3. When I try to train with large backbone, I have to reduce the ’samples_per_gpu‘, I meet a bug called 'assert pred.size() == target.size() and target.numel() > 0', for example when ’samples_per_gpu‘ equals 2 or 3 or 4.
  4. 'assert pred.size() == target.size() and target.numel() > 0' is a common bug when I do reproduction and training. I check the params and find that target.size() = [0,2], and have no idea what happened.

plz help me with this issues. Looking forward your reply.
Thank you.

@sverdoot
Copy link

sverdoot commented Jul 14, 2022

Actually you can either ignore the lines from 3rd and 4th points or replace target.numel() > 0 with target.numel() >= 0.

@romeosgood
Copy link
Author

Actually you can either ignore the lines from 3rd and 4th points or replace target.numel() > 0 with target.numel() >= 0.

Thx for your advice! I'll try a second time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants