Wearable Depth-Sensing Projection System Makes Any Surface Capable of Multitouch Interaction, Carnegie Mellon University Reveals

OmniTouch, a wearable projection system developed by researchers at Microsoft Research and Carnegie Mellon University, enables users to turn pads of paper, walls or even their own hands, arms and legs into graphical, interactive surfaces. OmniTouch employs a depth-sensing camera, similar to the Microsoft Kinect, to track the user's fingers on everyday surfaces. This allows users to control interactive applications by tapping or dragging their fingers, much as they would with touchscreens found on smartphones or tablet computers. The projector can superimpose keyboards, keypads and other controls onto any surface, automatically adjusting for the surface's shape and orientation to minimize distortion of the projected images.