4 / 4 Natural Language Processing

Bigram Probability By Hand

A bigram model is estimated by maximum likelihood from this three-sentence corpus, using

P(wn∣wn−1)=C(wn−1wn)C(wn−1)P(w_n \mid w_{n-1}) = \frac{C(w_{n-1} w_n)}{C(w_{n-1})}

<s> I am Sam </s>
<s> Sam I am </s>
<s> I do not like green eggs and ham </s>

What probability does the model assign to <s> I am Sam </s>?

A

1/6≈0.1671/6 \approx 0.167

B

1/9≈0.1111/9 \approx 0.111

C

2/9≈0.2222/9 \approx 0.222

D

≈0.0044\approx 0.0044