Skip to content

Commit

Permalink
fix a typo in lang-model.md (#388)
Browse files Browse the repository at this point in the history
  • Loading branch information
rebounding authored and astonzhang committed Sep 26, 2018
1 parent 52faeed commit 34e3d7e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion chapter_recurrent-neural-networks/lang-model.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ $$\mathbb{P}(w_1, w_2, w_3, w_4) = \mathbb{P}(w_1) \mathbb{P}(w_2 \mid w_1) \ma

## $N$元语法

当序列长度增加时,计算和存储多个词共同出现的概率会指数增加。$N$元语法通过马尔可夫假设(虽然并不一定成立)简化了语言模型的计算。马尔可夫假设是指一个词的出现至于前面$n$个词相关,即$n$阶马尔可夫假设。如果$n=1$,那么我们有$\mathbb{P}(w_3 \mid w_1, w_2) = \mathbb{P}(w_3 \mid w_2)$。如果基于$n-1$阶马尔可夫假设,我们将语言模型改写为
当序列长度增加时,计算和存储多个词共同出现的概率会指数增加。$N$元语法通过马尔可夫假设(虽然并不一定成立)简化了语言模型的计算。马尔可夫假设是指一个词的出现只与前面$n$个词相关,即$n$阶马尔可夫假设。如果$n=1$,那么我们有$\mathbb{P}(w_3 \mid w_1, w_2) = \mathbb{P}(w_3 \mid w_2)$。如果基于$n-1$阶马尔可夫假设,我们将语言模型改写为

$$\mathbb{P}(w_1, w_2, \ldots, w_T) \approx \prod_{t=1}^T \mathbb{P}(w_t \mid w_{t-(n-1)}, \ldots, w_{t-1}) .$$

Expand Down

0 comments on commit 34e3d7e

Please sign in to comment.