This paper describes a head-tracking algorithm that is based on recognition and correlation-based weighted interpolation. The input is a sequence of 3D depth images generated by a novel time-of-flight depth sensor. These are processed to segment the background and foreground, and the latter is used as the input to the head tracking algorithm, which is composed of three major modules: First, a depth signature is created out of the depth images. Next, the signature is compared against signatures that are collected in a training set of depth images. Finally, a correlation metric is calculated between most possible signature hits. The head location is calculated by interpolating among stored depth values, using the correlation metrics as the weights. This combination of depth sensing and recognition-based head tracking provides more than 90 percent success. Even if the track is temporarily lost, it is easily recovered when a good match is obtained from the training set. The use of depth images and recognition-based head tracking achieves robust real-time tracking results under extreme conditions such as 180-degree rotation, temporary occlusions, and complex backgrounds.
3D head tracking based on recognition and interpolation using a time-of-flight depth sensor
2004-01-01
392035 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
3D Head Tracking Based on Recognition and Interpolation Using a Time-of-Flight Depth Sensor
British Library Conference Proceedings | 2004
|Sensor fusion based head pose tracking for lightweight flight cockpit systems
Tema Archiv | 2011
|Systems and methods for head position interpolation for user tracking
Europäisches Patentamt | 2023
|Systems And Methods For Head Position Interpolation For User Tracking
Europäisches Patentamt | 2022
|