Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accuracy of sigmoid layer's output drops a lot #23

Open
Railcalibur opened this issue Jun 3, 2024 · 1 comment
Open

Accuracy of sigmoid layer's output drops a lot #23

Railcalibur opened this issue Jun 3, 2024 · 1 comment

Comments

@Railcalibur
Copy link

platform: Jetson AGX Orin 64GB
OS: 5.1.2
DLA: 3.12.1

Sigmoid layers are used as the output of the model and the input & output shape of sigmoid is (8, 3, 88, 160). I found the accuracy of fp16 dla model drops a lot when I use sigmoid as output layer. However, the outputs is consistent to torch outputs if the sigmoid is removed, with the cosine similarity close to 1.

I want to know what is the limitations on the use of sigmoid layers ?
Why does this loss of precision occur ?

@nvoliver
Copy link
Collaborator

@Railcalibur Is this issue still occurring with the latest JetPack 6.0? Also, does it occur with batch size 1, such that the shape is (1, 3, 88, 160). Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants