We already know that the four-step transition matrix is given by
The probability of going from state 3 to state 1 in four steps is the (3, 1) entry of this matrix: 1/8.
To return to the review exercises, just close this window.