$P=\left(\matrix{0.7 \ \ \ \ 0.3\\0.6 \ \ \ \ 0.4}\right)$ be the transition probability matrix of finite markov chain wtih 2 states, $1,2$ and what is the probability that in long run, $P(X_n=1)$?
I know how to find stationary distribution but the solution suggest that it is equal to $\frac{0.6}{0.6+0.3}$ without using any stationary distribution and i don't quite get how it gets that.
Best Answer
You could try to show the following:
Of course, such a characterization is specific to the two-states case.