The use of human hand motions as an effective way to interact with computers/robots, robot manipulation learning and prosthetic hand control is being researched in-depth. This~paper proposes a novel and effective multiple sensor based hand motion capture and recognition system. Ten common predefined object grasp and manipulation tasks demonstrated by different subjects are recorded from both the human hand and object points of view. Three types of sensors, including~electromyography, data glove and FingerTPS are applied to simultaneously capture the EMG signals, the finger angle trajectories, and the contact force. Recognising different grasp and manipulation tasks based on the combined signals is investigated by using an adaptive directed acyclic graph algorithm, and results of comparative experiments show the proposed system with a higher recognition rate compared with individual sensing technology, as well as other algorithms. The proposed framework contains abundant information from multimodal human hand motions with the multiple sensor techniques, and it is potentially applicable to applications in prosthetic hand control and artificial systems performing autonomous dexterous manipulation.


    Access

    Download


    Export, share and cite



    Title :

    Multiple sensors based hand motion recognition using adaptive directed acyclic graph


    Contributors:
    Xue, Yaxu (author) / Ju, Zhaojie (author) / Xiang, Kui (author) / Chen, Jing (author) / Liu, Honghai (author)

    Publication date :

    2017-04-05


    Remarks:

    Xue , Y , Ju , Z , Xiang , K , Chen , J & Liu , H 2017 , ' Multiple sensors based hand motion recognition using adaptive directed acyclic graph ' Applied Sciences , vol 7 , no. 4 , 358 . DOI:10.3390/app7040358



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Directed acyclic graph representation of deformable models

    Goldenstein, S. / Vogler, C. / Metaxas, D. | IEEE | 2002


    Directed Acyclic Graph Representation of Deformable Models

    Goldenstein, S. / Vogler, C. / Metaxas, D. | British Library Conference Proceedings | 2002


    Directed Acyclic Graph Continuous Max-Flow Image Segmentation for Unconstrained Label Orderings

    Baxter, J. S. / Rajchl, M. / McLeod, A. J. et al. | British Library Online Contents | 2017



    Template-Based Hand Pose Recognition Using Multiple Cues

    Stenger, B. | British Library Conference Proceedings | 2006