Plan-view projection of real-time depth imagery can improve the statistics of its intrinsic 3D data, and allows for cleaner separation of occluding and closely-interacting people. We build a probabilistic, real-time multi-person tracking system upon a plan-view image substrate that well preserves both shape and size information of foreground objects. The tracking's robustness derives in part from its "plan-view template" person models, which capture detailed properties of people's body configurations. We demonstrate that these same person models, obtained with a single compact stereo camera unit, may also be used for fast recognition of body pose and activity. Principal components analysis is used to extract plan-view "eigenposes", onto which person models, extracted during tracking, are projected to produce a compact representation of human body configuration. We then formulate pose recognition as a classification problem, and use support vector machines (SVMs) to quickly distinguish between, for example, different directions people are facing, and different body poses such as standing, sitting, bending over, crouching, and reaching. The SVM outputs are transformed to probabilities and integrated across time in a probabilistic framework for real-time activity recognition.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Fast, integrated person tracking and activity recognition with plan-view templates from a single stereo camera


    Contributors:
    Harville, M. (author) / Dalong Li, (author)


    Publication date :

    2004-01-01


    Size :

    647844 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Fast, Integrated Person Tracking and Activity Recognition with Plan-View Templates from a Single Stereo Camera

    Harville, M. / Li, D. / IEEE Computer Society | British Library Conference Proceedings | 2004



    Integrated Person Tracking Using Stereo, Color, and Pattern Detection

    Darrell, T. / Gordon, G. / Harville, M. et al. | British Library Online Contents | 2000


    STEREO CAMERA AND LIGHT UNIT WITH INTEGRATED STEREO CAMERA

    SHIMANO TAKESHI / BETSUI KEIICHI / MONJI TATSUHIKO | European Patent Office | 2023

    Free access

    REAR-VIEW STEREO CAMERA SYSTEM

    LEPPIN HEIKO / HEINRICH STEFAN | European Patent Office | 2025

    Free access