Development of user-friendly contents is an important key to
make the system popular to ordinary people [2]. In terms of
3D contents, tons of applications have been developed, however,
only games made a success and few other applications
are known. Recently, the framework of an interactive 3D animation
was proposed [1]. It uses a state transition graph to
represent the transition of a 3D object as a 3D animation such
as ”raise a hand”, ”open a tab,” etc. One of the drawbacks of
the system is that it requires several manual processes to make
the contents, such as creation of 3D animations, construction
of the graph and definition of the gestures to the graph. Further,
there is no solution described how to solve the ambiguity
between 2D gesture and 3D motion.