Probability – What Values Make a Markov Chain Aperiodic?

markov chainsprobability

Let the following transition matrix represent a $4$ state Markov chain
$$\begin{pmatrix}
0 & a & 0 & b \\
\frac{1}{2} & 0 & \frac{1}{3}+c & d \\
0 & a & 0 & b \\
e & 0 & f & 0
\end{pmatrix}$$
Let all the constants be positive real numbers, what values of these would make the chain aperiodic?
Any help here is greatly appreciated, because I can't see how to do this other than finding an expression for the $n$th power of the matrix at the diagonal values

Best Answer

If all of $a,b,c,d,e,f$ are $>0$, then the chain is aperiodic. Starting in state 2 you can go $2\to1\to2$ or $2\to4\to1\to2$ with non-zero probability. Hence, the period of state 2 divides both 2 and 3, and so the period of state 2 is 1. Since the chain is irreducible, all states are aperiodic.

If, for example, $a=0$ then the chain is not even irreducible.