Natural User Interfaces (NUI) has started to evolve more rapidly in the past few years with the gesture-based interfaces that use touch or touch-less interactions or the full body to enable rich interactions with a computing device._But, none of these have changed the way of interacting with_traditional desktop computing using keyboard and mouse. With this patent, Microsoft is describing a_gesture based system for desktop_which allows you to control_elements of these tasks such as mode switches, window and task management, menu selection and certain types of navigation which are offloaded to shortcut and modifier keys or context menus. Summary: The following presents a simplified summary of the disclosure in order to provide a basic understanding to the reader. This summary is not an extensive overview of the disclosure and it does not identify key/critical elements or delineate the scope of the specification. Its sole purpose is to present a selection of concepts disclosed herein in a simplified form as a prelude to the more detailed description that is presented later. Described...

The rest of the story...
Microsoft News