This paper presents an automatic Australian sign language (Auslan) recognition system, which tracks multiple target objects (the face and hands) throughout an image sequence and extracts features for the recognition of sign phrases. Tracking is performed using correspondences of simple geometrical features between the target objects within the current and the previous frames. In signing, the face and a hand of a signer often overlap, thus the system needs to segment these for the purpose of feature extraction. Our system deals with the occlusion of the face and a hand by detecting the contour of the foreground moving object using a combination of motion cues and the snake algorithm. To represent signs, features that are invariant to scaling, 2D rotations, and signing speed are used for recognition. The features represent the relative geometrical positioning and shapes of the target objects, as well as their directions of motion. These are used to recognise Auslan phrases using Hidden Markov Models. Experiments were conducted using 163 test sign phrases with varying grammatical formations. Using a known grammar, the system achieved over 97% recognition rate on a sentence level and 99% success rate at a word level.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Automatic Recognition of Colloquial Australian Sign Language


    Beteiligte:
    Holden, Eun-Jung (Autor:in) / Lee, Gareth (Autor:in) / Owens, Robyn (Autor:in)


    Erscheinungsdatum :

    01.01.2005


    Format / Umfang :

    239736 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Australian sign language recognition

    Holden, E. J. / Lee, G. / Owens, R. | British Library Online Contents | 2005


    Automatic Recognition of Arabic Sign Language Finger Spelling

    Al-Rousan, M. / Hussain, M. | British Library Online Contents | 2001


    Viewpoint invariant sign language recognition

    Wang, Q. / Chen, X. / Zhang, L. G. et al. | British Library Online Contents | 2007


    Viewpoint invariant sign language recognition

    Qi Wang, / Xilin Chen, / Liangguo Zhang, et al. | IEEE | 2005


    Viewpoint Invariant Sign Language Recognition

    Wang, Q. / Chen, X. / Zhang, L. et al. | British Library Conference Proceedings | 2005