The i th row of P, for i=0,1,…, is the probability distribution of the values of Xn+1 under the condition that Xn = i. If the number of states is finite, then P is a finite square matrix whose order (the number of rows) is equal to the number of states. Clearly, the quantities Pij satisfy the conditions