Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The arch figure doesn't comform to the code #250

Open
kytimmylai opened this issue Jun 25, 2024 · 1 comment
Open

The arch figure doesn't comform to the code #250

kytimmylai opened this issue Jun 25, 2024 · 1 comment

Comments

@kytimmylai
Copy link

I found that in the arch figure of gated CNN block, the concat part is missing, and the gate branch and conv should share the same linear layer. This adjustment would bring the figure closer to the intended inference.

@yuweihao
Copy link
Owner

Hi @kytimmylai ,

  • the conv can be standard depthwise convolution or depthwise conv on partial channels (like InceptionNeXt), controlled by the conv ratio.
  • the gate branch and conv branch do not share the same linear (linear + split).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants