The Kinect sensor captures the color and geometry of the scene, and the system renders the illusions using the ac-quired depth map. Careful calibration of the system is re-quired in order for the illusions to tightly match the on-screen content and the physical environment. The calibra-tion of the IllumiRoomsystem is fully automatic, determin-ing the relative pose of the projector to the depth sensor and the position of the television in the projector image. There-fore, setup only requires that the projector and depth camera are placed such that they cover the area surrounding the TV.