The hidden states are not directly visible,
but output dependent on the hidden state is visible.
Each hidden state has a probability over the possible out symbol.
Hence, the sequence of observation symbols generated by an HMM gives some information about the sequence of hidden states.