This paper describes a head-tracking algorithm that is based on recognition and correlation-based weighted interpolation. The input is a sequence of 3D depth images generated by a novel time-of-flight depth sensor. These are processed to segment the background and foreground, and the latter is used as the input to the head tracking algorithm, which is composed of three major modules: First, a depth signature is created out of the depth images. Next, the signature is compared against signatures that are collected in a training set of depth images. Finally, a correlation metric is calculated between most possible signature hits. The head location is calculated by interpolating among stored depth values, using the correlation metrics as the weights. This combination of depth sensing and recognition-based head tracking provides more than 90 percent success. Even if the track is temporarily lost, it is easily recovered when a good match is obtained from the training set. The use of depth images and recognition-based head tracking achieves robust real-time tracking results under extreme conditions such as 180-degree rotation, temporary occlusions, and complex backgrounds.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    3D head tracking based on recognition and interpolation using a time-of-flight depth sensor


    Contributors:
    Gokturk, S.B. (author) / Tomasi, C. (author)


    Publication date :

    2004-01-01


    Size :

    392035 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    3D Head Tracking Based on Recognition and Interpolation Using a Time-of-Flight Depth Sensor

    Gokturk, S. / Tomasi, C. / IEEE Computer Society | British Library Conference Proceedings | 2004


    Sensor fusion based head pose tracking for lightweight flight cockpit systems

    Luo, Bin / Wang, Yongtian / Liu, Yue | Tema Archive | 2011


    Systems and methods for head position interpolation for user tracking

    HASSANI ALI / HANSON RYAN / AMADI LAWRENCE CHIKEZIRI | European Patent Office | 2023

    Free access

    Systems And Methods For Head Position Interpolation For User Tracking

    HASSANI ALI / HANSON RYAN / AMADI LAWRENCE CHIKEZIRI | European Patent Office | 2022

    Free access

    System and method for head position interpolation for user tracking

    HASSANI ALI / HANSON RYAN / AHMADI LAWRENCE CHIKKIRI | European Patent Office | 2022

    Free access