Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configurations for the gated and film #1

Open
dori2063 opened this issue May 16, 2023 · 1 comment
Open

Configurations for the gated and film #1

dori2063 opened this issue May 16, 2023 · 1 comment

Comments

@dori2063
Copy link

dori2063 commented May 16, 2023

Thank you for your kind response, Ruize.

I checked the accuracy of the gated and film with the updated code.
However, each accuracy with mmcosine was about 0.57 on CREMA-D for 200 epochs and a scaling of 2.
(without mmcosine was about 0.60)
Do you have any recommended configurations for them with mmcosine?

  • In basic_model.py (line34,36), x_film and x_gate should be erased.
@Rick-Xu315
Copy link
Contributor

Hi, thanks for your reminder! For FiLM and Gated, the scaling parameter empirically should be much larger, such as 50. Please try it or larger values to find the best result on your device, for we just did coarse search in our experiments.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants