A method for the simultaneous localization and recognition of dynamic hand gestures is proposed. At the core of this method is a dynamic space-time warping (DSTW) algorithm, that aligns a pair of query and model gestures in both space and time. For every frame of the query sequence, feature detectors generate multiple hand region candidates. Dynamic programming is then used to compute both a global matching cost, which is used to recognize the query gesture, and a warping path, which aligns the query and model sequences in time, and also finds the best hand candidate region in every query frame. The proposed framework includes translation invariant recognition of gestures, a desirable property for many HCI systems. The performance of the approach is evaluated on a dataset of hand signed digits gestured by people wearing short sleeve shirts, in front of a background containing other non-hand skin-colored objects. The algorithm simultaneously localizes the gesturing hand and recognizes the hand-signed digit. Although DSTW is illustrated in a gesture recognition setting, the proposed algorithm is a general method for matching time series, that allows for multiple candidate feature vectors to be extracted at each time step.
Simultaneous Localization and Recognition of Dynamic Hand Gestures
2005-01-01
309805 byte
Conference paper
Electronic Resource
English
Hand Gestures Recognition for an Intelligent Wheelchair Steering Command
Springer Verlag | 2022
|Recognition of Shape-Changing Hand Gestures Based on Switching Linear Model
British Library Conference Proceedings | 2001
|Graph-Based Matching of Occluded Hand Gestures
British Library Conference Proceedings | 2001
|