Augmented Reality Sandbox
UC Davis' W.M. Keck Center for Active Visualization in the Earth Sciences (KeckCAVES), together with the UC Davis Tahoe Environmental Research Center, Lawrence Hall of Science, and ECHO Lake Aquarium and Science Center, is involved in an NSF-funded project on informal science education for freshwater lake and watershed science. As part of this project, we are primarily developing 3D visualization applications to teach earth science concepts, but we also built a hands-on exhibit combining a real sandbox, and virtual topography and water created using a closed loop of a Microsoft Kinect 3D camera, powerful simulation and visualization software, and a data projector. The resulting augmented reality (AR) sandbox allows users to create topography models by shaping real sand, which is then augmented in real time by an elevation color map, topographic contour lines, and simulated water. The system teaches geographic, geologic, and hydrologic concepts such as how to read a topography map, the meaning of contour lines, watersheds, catchment areas, levees, etc.
This project was inspired by a video created by a group of Czech researchers, who demonstrate an early prototype of an AR sandbox with elevation color mapping and some limited form of fluid flow. There is an even earlier project, Project Mimicry, of which we learned only later; it also appears to only be in early testing phase.