The 2dn gen Microsoft Surface Touch Covers already supports gesture in them. But, you have to perform the gestures on the keyboard. This new project from Microsoft Research will allow you to perform gestures over the keyboard without even touching them. Such user experience is enabled_by low-resolution matrix of infrared (IR) proximity sensors_between the keys of the mechanical keyboard. Watch the video_demo above. We present a new type of augmented mechanical keyboard, sensing rich and expressive motion gestures performed both on and directly above the device. A low-resolution matrix of infrared (IR) proximity sensors is interspersed with the keys of a regular mechanical keyboard. This results in coarse but high frame-rate motion data. We extend a machine learning algorithm, traditionally used for static classification only, to robustly support dynamic, temporal gestures. We propose the use of motion signatures a technique that utilizes pairs of motion history images and a random forest classifier to robustly recognize a large set of motion gestures. Our technique achieves a mean per-frame classification accuracy of...

The rest of the story...
Microsoft News