then the process is said to be in state . We suppose that whenever the process is in state i, there is a fixed probability that it will next be in state j. That is, we suppose that
then the process is said to be in state . We suppose that whenever the process is in state i, there is a fixed probability that it will next be in state j. That is, we suppose that