As autonomous driving technologies advance, occupants are expected to be free from driving, diversifying interaction scenarios with vehicles. Despite the growing importance of in-vehicle occupant monitoring systems, most existing systems focus on the face or head tracking of occupants, and only a few studies have attempted to detect their poses. In this paper, we present the first in-vehicle environment-specialized framework for the joint estimation of 3D human pose and shape from a single image. To this end, we introduce a new dataset called Human In VEhicles (HIVE), which contains a large collection of synthesized humans with different shapes and poses in vehicle images. HIVE provides RGB and NIR in-vehicle image pairs with ground-truth 2D and 3D pose and shape annotations, respectively. In addition, to exploit the different characteristics of humans in vehicles and unconstrained environments, we present a new pose prior penalizing poses that deviate from in-vehicle poses. The pose prior is derived using a variational autoencoder trained with in-vehicle human pose data. By using the proposed HIVE dataset and pose prior along with an elaborately designed two-stage training procedure, our method exhibits significantly improved pose and shape estimation performance compared with state-of-the-art methods for real-world test images captured in vehicles under different conditions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Pose and Shape Estimation of Humans in Vehicles


    Contributors:


    Publication date :

    2024-01-01


    Size :

    4487365 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    6D POSE AND SHAPE ESTIMATION METHOD

    MEIER SVEN / KOBORI NORIMASA / MINCIULLO LUCA et al. | European Patent Office | 2023

    Free access

    Pedestrian Pose Estimation for Campus Unmanned Delivery Vehicles

    Jiang, Yuzhu / Li, Ying / Yang, Chao et al. | IEEE | 2023


    Simultaneous Segmentation and Pose Estimation of Humans Using Dynamic Graph Cuts

    Kohli, P. / Rihan, J. / Bray, M. et al. | British Library Online Contents | 2008


    Model-free non-rigid head pose tracking by joint shape and pose estimation

    Cristina, S. / Camilleri, K. P. | British Library Online Contents | 2016


    Vision based Real-Time Pose Estimation for Intelligent Vehicles

    Yang, M. / Yu, Q. / Wang, H. et al. | British Library Conference Proceedings | 2004