HAND GESTURE BASED HUMAN COMPUTER INTERACTION Hand Gesture

HAND GESTURE BASED HUMAN COMPUTER INTERACTION

Hand Gesture Based Applications – Computer Interface • A 2 D/3 D input device (Hand Tracking) • Translation of gestures to commands • More natural interface for 3 D design applications – Aid for disabled and deaf people • Sign language analysis, translation • Sign language teaching • Using multimodality to enable communication between disabled people – Entertainment • Applications involving hand gesture recognition, from computer games to sound and image design applications

HMM Based Hand Gesture Recognition Process • The System Marker Segmentation Left Image Right Image 2 D Kalman Filter 3 D Reconstruction Vector Quantizer 3 D Kalman Filter Gesture Spotter Application

Gesture Recognition System Setup • Requirements: • 2 D Gesture Recognition System: 1. A simple webcam capable of acquiring RGB images • 3 D Gesture Recognition System: 1. Two simple webcams capable of acquiring RGB images 2. A mainboard capable of handling two webcams • No special equipment required

Gesture Recognition System Setup

3 D GESTURES

Capabilities • Recognition of 2 D and 3 D gestures in real time • Real time hand tracking – controlling mouse motion • Capability of triggering windows input device events – controlling third party applications

Future Work • • Usage of IOHMM, HMM ANN hybrids A visualization module for the HMMs Combining with body and face analyzers Real time recognition of simple sign language gestures • Inclusion of hand posture in recognition process

Demonstration