This means that the behavior of the systems must be the same at all points of time irrespective of the point of time being considered, i.e., the probability making a transition from one given state to another is the same (stationary) at all times in the past and future.