Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Which kind of BERT version is used? #4

Open
lanzhuzhu opened this issue Apr 13, 2021 · 0 comments
Open

Which kind of BERT version is used? #4

lanzhuzhu opened this issue Apr 13, 2021 · 0 comments

Comments

@lanzhuzhu
Copy link

Thanks for your open sourcing. This work is really solid. I have some questions about the implementation.

Which kind of BERT is used in your paper? As we know BERT_LARGE or BERT_BASE could bring a quite different performance due to the number of parameters.

Even though the default setting is BERT_BASE, it would be better to clarify the used version of BERT somewhere in your paper or Github. I asked this because I fine-tuned the BERT_BASE_UNCASED model as a relation classifier but the final F1 score on the original test dataset is 0.6128, much lower than SpanBERT or KnowBERT. The result of BERT RE model is not clear in your work, so it is hard to compare.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant