The main purpose in this paper is to show that the transition matrix generated under semi-tensor product approach (Here we call it the probability structure matrix for simplicity) and the traditional approach (Transition probability matrix) are similar to each other