Figure 1 shows a service model of augmented TV. The
viewer captures the broad casted TV program, called main
content, from the TV screen by using the mobile device camera
and watches the mobile device screen, which is running an
augmented TV application. In the mobile device, animated
3DCG content related to the TV program, called sub content, is
downloaded from the Internet in advance. Then, it is computed based on the viewer's circumstances, especially the relative position of the TV screen and the mobile device, and overlaid on the live video from the mobile device camera. The sub content has a scenario with a time code, and the scenario is driven in accordance with the playback time of the sub content, called mobile time, indicating the time code to be interlocked with the main content.