Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add discussion of BERT #4

Open
vanatteveldt opened this issue Feb 4, 2023 · 1 comment
Open

Add discussion of BERT #4

vanatteveldt opened this issue Feb 4, 2023 · 1 comment
Labels
Request/plan: addition Add a section (or chapter) on a topic currently not covered

Comments

@vanatteveldt
Copy link
Owner

We have a section on embeddings, but nothing on transformers / BERT models. This obviously needs to change

@vanatteveldt vanatteveldt added the Request/plan: addition Add a section (or chapter) on a topic currently not covered label Feb 4, 2023
@vanatteveldt
Copy link
Owner Author

Concretely, I think we should add a general section in chapter 8.4 on encoder / transformer models, and add a specific section in 11.4 on BERT models for text analysis.

We might also have to review the general text about bag-of-word models to make sure it reflects that for current language models these are generally not used.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Request/plan: addition Add a section (or chapter) on a topic currently not covered
Projects
Status: No status
Development

No branches or pull requests

1 participant