Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing interactions: global test using F test with approximate degrees of freedom instead of LRT #270

Open
giulianonetto opened this issue Jun 19, 2024 · 1 comment
Labels
invalid This doesn't seem right

Comments

@giulianonetto
Copy link

Hello!

Thank you for this amazing methodology and package! Please, I have a question about .ancombc_global_LRT.

From the source code, .ancombc_global_LRT seems to be doing a LRT between full and reduced models using two corresponding lmerTest::lmerModLmerTest objects.

From my understanding of the lmerTest paper and corresponding docs, the authors suggest using the anova.lmerModLmerTest method on the full model directly so that you can benefit from the implemented F tests with approximately correct degrees of freedom, avoiding the anti-conservativeness of the LRT in this setting.

Is this compatible with the ANCOMBC2 methodology? It seems to be a matter of removing the reduced model from .ancombc_global_LRT and adjusting downstream parsing accordingly (happy to PR if needed).

My motivation for this question is that I wanted to test the significance of interaction effects. I planned to implement this by running a global test using a model matrix from a fixed-effects formula of the form ~ x + time_point + x:time_point, where I would append a prefix "interaction" on the interaction terms and set group="interaction". Does this make sense? (sorry for the double question).

Thank you very much!

@Maggie8888
Copy link
Collaborator

Thanks for your question. I'm not sure if I fully understand your question. Are you wondering how to test if the interaction term is significant or not? You can specify full model as the one including interaction term and reduced model as the one without that interaction term. The LRT will tell you if the interaction term is significant or not.

@Maggie8888 Maggie8888 added the invalid This doesn't seem right label Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invalid This doesn't seem right
Projects
None yet
Development

No branches or pull requests

2 participants