Understanding driver's foot behavior helps reduce pedal-related traffic accidents. Conventional systems introduced wearable devices to track drivers' foot motion and tracking drivers' feet using non-contact sensors is still challenging. Moreover, to better understand driver's foot behavior, it is required to stably track drivers' small foot motion and at the joint level. To cope with this problem, we develop a novel foot motion tracking system, referred to as 'JointFlow.’ This system integrates a pose estimation model, i.e., OpenPose, with Optical Flow. At first, a keypoint region-based convolutional neural network (keypoint R-CNN) is trained to detect the joints of the foot. At the same time, the Lucas-Kanade algorithm of Optical Flow is used to calculate the motion of each foot joint between consecutive frames. We implemented and evaluated the system using a real-world driving dataset of 50 drivers. The evaluation result shows that JointFlow could track both small and large foot motion. By comparing with the conventional pose estimation model, we could confirm that JointFlow tracked small foot motion more stable.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    JointFlow: A Foot Motion Tracking Model Combining Pose Estimation Model with Optical Flow


    Contributors:


    Publication date :

    2022-10-08


    Size :

    715924 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Model-free non-rigid head pose tracking by joint shape and pose estimation

    Cristina, S. / Camilleri, K. P. | British Library Online Contents | 2016


    Model-based head tracking and 3D pose estimation [3457-09]

    Preteux, F. / Malciu, M. / SPIE | British Library Conference Proceedings | 1998


    Optical Flow Estimation using Wavelet Motion Model

    Wu, Y.-T. / Kanade, T. / Cohn, J. et al. | British Library Conference Proceedings | 1998


    Direct model based visual tracking and pose estimation using mutual information

    Caron, G. / Dame, A. / Marchand, E. | British Library Online Contents | 2014


    Initial Pose Estimation for 3D Model Tracking Using Learned Objective Functions

    Wimmer, Matthias / Radig, Bernd | Springer Verlag | 2007