Here it can be seen that the Bricket led Carl to some of the same concepts
that are explored in the area of multimodal output synthesis,
and multimodal data visualization. The human-computer interaction
field has been investigating this area for years, attempting to come up
with frameworks for analysis and heuristics for implementations (as in
Andre, 1993). Carl's ideas about representation shared a common base
with many of these researchers' approaches. He found intuitive mappings
between inputs and outputs in different modalities, and was able
to understand and act on multiple outputs that were received at the same
time.