Part (a) With the states numbered as in the diagram, the transition matrix is

Using the methods in the text, we calculate the steady state vector as
Part (b) If you calculate P^{2}, you find that P^{2} = P. Thus, all powers of P are equal to P. Since there are zero entries in P, it follows that there will be zero entries in all powers of P. Hence, P is not regular.
To return to the review exercises, just close this window.