Providing Hand Gesture Interaction for Your Windows PC (Patent # 61/903,774)

Gesture 1.0

TEDI Gesture 1.0 will provide the end user functionality of the keyboard and mouse with hand gesture interaction with Windows 8, Windows 8.1, SharePoint 2013, Visual Studio 2012, Office 2013 Professional, Visio 2013, and Project 2013. Supplementation of keyboard and mouse functionality with the use of hotkey commands, point to click, Office/SharePoint Ribbon interaction, custom hand gestures, enhanced scrolling, and vocal commands in working with Microsoft Products provided by the Microsoft Kinect for Windows device. Duplication of actions such as opening Windows applications, IE Explorer utilization, Windows OS functionality, GUI functionality of SharePoint 2013, Visual Studio enhancements, PowerShell, and utilization of MS Office 2013.

Gesture 1.0 Design Overview

With the advent of Microsoft Kinect and TEDI Gesture, the end user will use natural hand motion and custom or default hand patterns to efficiently provide the local machine commands in the same way a Mousedevice Class will behave:


TEDI Gesture will increase the speed to interact with the Windows operating system and various Microsoft applications while promoting a fluid and natural use of hot keys, point to click events, and other physical interactions between the end user and desktop computer. Therefore, practical applications such as gaming, application development, Microsoft Office use, penetration testing, and other utilizations for computing will be enhanced. This will expedite interaction timing, faster more efficient control of the machine, and potentially eliminate the need for a mouse or trackball.

Added Value Analysis

Gesture 1.0 Graphical User Interface (GUI)

Kinect Gesture 1.0 provides the end user the ability to mold and define the user experience with Kinect Gesture. Therefore, the feel, efficiency, and capabilities of the end user can be configured for the specific needs of any user for the functions they require (e.g. developer vs everyday user)

  • Gesture Graphical User Interface (GUI) 100%

Operating System Functionality

Operations and commands performed within the operating system can be performed through defaulted hand gestures and point to click. This allows for more expedient implementation of controls, configuration, and utilization of primary Windows features and Microsoft applications. With the advent of configuring hand gestures, the end user can establish new hand gestures to replace defaults in making the end user experience customized to control their Windows OS which can also allow for a more fluid control of the interface. Therefore, speed and efficiency will be gained by the end user. For example, gestures can be established for accessing Windows Control Panel features (e.g. Add New User). This can range from 5 to 11 click events of the mouse. Established hand gestures bypass all of these click events to a single hand gesture that is defaulted and can be configured. Therefore, only 1 event will produce Add New User screen versus 8 click events b drastically decreasing time to access critical systems and functionality.

  • Operating System Functionality & Hotkeys 100%

Internet Browsing Operability

Defaulted hand gestures can open the IE Explorer (7 and up) and navigate the internet. Functions such as (but not limited to) adding a web page to favorites, click events for links, and opening internet options interface can be performed through Kinect Gesture. Functionality such IE Explorer favorites can be given additional hand gestures so an end user can access a particular favorite URL by a hand gesture vs click event. This drastically decreases time to access and perform internet browsing through a decrease in events that are required to access IE explorer and its features.

  • Internet Browsing Operability & Speed 100%

Enhanced MS Office

Functionality of MS office has improved through the integration of Kinect Gesture. Office Ribbon commands and interactions can now be performed through Kinect Gesture through point-to-click events. In addition, gesture commands are defaulted on many of the ribbon functionality of Microsoft Office. These can be toggled and configured for specific end user needs through the Kinect Gesture 1.0 user interface. Added value includes faster event times for out of box features for MS Office. Click events for performing style things like style changes, track changes, and other MS Office features can be activated, deactivated, and even configured through a composite of hand gestures. This greatly decreases the time to operate with the technology, saving energy and opportunity cost to perform previous functions through the mouse and keyboard.

  • Enhanced MS Office Experience 95%

Enhanced Application Operability

Applications that are outside of the hand gesture suite but still entertain benefits through point-to-click events and enhanced scrolling.B Functionality of using a mouse is replicated and enhanced through Microsoft Kinect which saves time in using hand movements to perform browsing and select functions with hand movements.

  • Enhanced Application Operability 90%

Enhanced Penetration Testing

Kinect Gesture was originally designed with the intent of enhancing penetration testing and ethical hacking. The ability to deploy scripts, create code, browse applications with speed/efficiency, and implement immediately required tasks was essential for tasks associated with penetration. This functionality still exists and can be used to improve the effectiveness and speed of security professionals implementing ethical hacking tools and capabilities such as penetration testing with Microsoft PowerShell.

  • Enhanced Penetration Testing 85%

Enhanced .NET Development

Enhanced development is performed by calling predefined functions, classes, and objects through hand gestures via Kinect Gesture. Utilizing PowerShell ISE and Visual Studio integration, a .NET developer can configure the use of hand gestures to call commonly used functions, classes, or objects through the use of hand gestures. This replaces or supplements the use of hotkeys to expedite the development process. Development time is truncated through the use of gestures to call functions, classes, or objects that are defined (preconfigured) but the end user. Configurations are performed through the Kinect Gesture 1.0.

  • Enhanced .NET Development Speed 90%

Minimum Specifications & System Requirements

Supported operating systems

  • Windows 8.1 (x64)
  • Windows 8 (x64)
  • Windows 7 SP1 (x64)
  • Windows Server 2012 R2 (x64)
  • 1.6 GHz or faster processor
  • 1 GB of RAM (1.5 GB if running on a virtual machine)
  • 10 GB of available hard disk space
  • 5400 RPM hard disk drive
  • DirectX 9-capable video card that runs at 1024 x 768 or higher display resolution
  • Internet Explorer 8 and up

Hardware requirements

  • 1.6 GHz or faster processor
  • 1 GB of RAM (1.5 GB if running on a virtual machine)
  • 10 GB of available hard disk space
  • 5400 RPM hard disk drive
  • DirectX 9-capable video card that runs at 1024 x 768 or higher display resolution

Additional Requirements:

  • Internet Explorer 8 and up