A more general notion of uncertainty in sequential decision making is the lack of
information on the options (now or in the future) or on the probability distributions
of outcomes of actions. Uncertainty in this sense resembles the notions of Knight
(1921) and may be popularly phrased as ‘unknown unknowns’. Information on
options or the probability distribution on effects of actions may possibly become
available only over time.