Stationary Distribution of a Candy Conveyor Belt Markov Chain
A conveyor belt dispenses two types of candy: chocolate (C) and jelly bean (J). The sequence is generated by a two-state Markov chain with the following transition probabilities:
$P(J | C) = \frac{4}{5}, \quad P(C | C) = \frac{1}{5}$
$P(C | J) = \frac{2}{3}, \quad P(J | J) = \frac{1}{3}$
Assuming the chain has been running long enough to reach stationarity, what fraction of candies are jelly beans?
Open the full interactive solver, hints, and worked solution →