of the environment causes changes to occur in environment state. What is important in
the above figure is that agent state is hidden – only the agent has access to it.
Environment state is visible to the agent but has to be stored by the agent if it is to be
reused at some later point in time when the agent has (presumably) moved to a
different location.