diff --git a/nlp_course/word_embeddings.html b/nlp_course/word_embeddings.html index 1efb643..76c5abd 100644 --- a/nlp_course/word_embeddings.html +++ b/nlp_course/word_embeddings.html @@ -622,8 +622,8 @@

Objective Function: Negative Log-Likelihood

For each position \(t =1, \dots, T\) in a text corpora, Word2Vec predicts context words within a m-sized window given the central word \(\color{#88bd33}{w_t}\): - \[\color{#88bd33}{\mbox{Likelihood}} = L(\theta)= - \prod\limits_{t=1}^T\prod\limits_{-m\le j \le m, j\neq 0}P(\color{#888}{w_{t+j}}|\color{#88bd33}{w_t}, \theta), \] + \[\color{#88bd33}{\mbox{Likelihood}} \color{black}= L(\theta)= + \prod\limits_{t=1}^T\prod\limits_{-m\le j \le m, j\neq 0}P(\color{#888}{w_{t+j}}|\color{#88bd33}{w_t}\color{black}, \theta), \] where \(\theta\) are all variables to be optimized.