Understanding driver's foot behavior helps reduce pedal-related traffic accidents. Conventional systems introduced wearable devices to track drivers' foot motion and tracking drivers' feet using non-contact sensors is still challenging. Moreover, to better understand driver's foot behavior, it is required to stably track drivers' small foot motion and at the joint level. To cope with this problem, we develop a novel foot motion tracking system, referred to as 'JointFlow.’ This system integrates a pose estimation model, i.e., OpenPose, with Optical Flow. At first, a keypoint region-based convolutional neural network (keypoint R-CNN) is trained to detect the joints of the foot. At the same time, the Lucas-Kanade algorithm of Optical Flow is used to calculate the motion of each foot joint between consecutive frames. We implemented and evaluated the system using a real-world driving dataset of 50 drivers. The evaluation result shows that JointFlow could track both small and large foot motion. By comparing with the conventional pose estimation model, we could confirm that JointFlow tracked small foot motion more stable.
JointFlow: A Foot Motion Tracking Model Combining Pose Estimation Model with Optical Flow
2022-10-08
715924 byte
Conference paper
Electronic Resource
English
Model-free non-rigid head pose tracking by joint shape and pose estimation
British Library Online Contents | 2016
|Model-based head tracking and 3D pose estimation [3457-09]
British Library Conference Proceedings | 1998
|Optical Flow Estimation using Wavelet Motion Model
British Library Conference Proceedings | 1998
|Direct model based visual tracking and pose estimation using mutual information
British Library Online Contents | 2014
|Initial Pose Estimation for 3D Model Tracking Using Learned Objective Functions
Springer Verlag | 2007
|