Part (a) With the states numbered as in the diagram, the transition matrix is

Using the methods in the text, we calculate the steady state vector as

Part (b) If you calculate P2, you find that P2 = P. Thus, all powers of P are equal to P. Since there are zero entries in P, it follows that there will be zero entries in all powers of P. Hence, P is not regular.


To return to the review exercises, just close this window.