The above figure summarizes the interactions between agent and environment. Agent
state along with environment state drives agent dynamics; i.e. agent action selection.
Agent action selection changes environment state through the creation or modification
of signals. Environment state is used as input to environment dynamics. The dynamics