Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CIN Con1d problems #18

Open
MarkovSc opened this issue Oct 24, 2019 · 2 comments
Open

CIN Con1d problems #18

MarkovSc opened this issue Oct 24, 2019 · 2 comments

Comments

@MarkovSc
Copy link

In paper, section 3.2 CIN analysis,

the number of weight at k-th layer is h_k * h_{k-1} *m.
Howerver in you code, you use the con1d which has the weight of h_k * h_{k-1} *m * d.

should we use the tf.nn.depthwise_conv1d but the con1d, hope your responses

@Leavingseason
Copy link
Owner

I couldn't find the function of 'depthwise_conv1d'. Considering that conv1d is actually implemented via reshaping the input and then send it to conv2d, may be what you mentioned is exactly the current implementation of conv1d?

@MarkovSc
Copy link
Author

MarkovSc commented Oct 29, 2019

In your version of CIN, the number of weight in k-th layer is field_nums[-1] * field_nums[0] *layer_size * dim。
The Con1d is the two-dimensional weight. But in the CIN analysis(section 3.2) , the CIN is independant of embedding dim which is just ( h_k * h_{k-1) * m in k-th layer)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants