Let us assume that the continuous bounded sets that form the state and control spaces have been discretized, as is the case in practice. The state is then represented by a finite set of points yi of the discrete space Ad. Likewise, the discrete control space Ud is represented by points noted uj, and each control space Udðt;yiÞis a subset of Ud. Then the transition equation (16) is given by the probabilities