Over the last years, pixel-wise analysis of semantic segmentation was established as a powerful method in scene understanding for autonomous driving, providing classification and 2D shape estimation even with monocular camera systems. Despite this positive resonance, a way to take advantage of this representation for the extraction of 3D information solely from a single-shot RGB image has never been presented.In this paper we present a full-fledged six degree-of-freedom vehicle pose estimation algorithm, demonstrating that a segmentation representation can be utilized to extract precise 3D information for non-ego vehicles. We train a neural network to predict a multi-class mask from segmentation, defining classes based on mechanical parts and relative part positions, treating different entities of a part as separate classes. The multi-class mask is transformed to a variable set of key points, serving as a set of 2D-3D correspondences for a Point-n-Perspective-solver. Our paper shows not only promising results for 3D vehicle pose estimation on a publicly available dataset but also exemplifies the high potential of the representation for vehicle state analysis. We present detailed insight on network configuration as well as correspondence calculation and their effect on the quality of the estimated vehicle pose.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    6DoF Vehicle Pose Estimation Using Segmentation-Based Part Correspondences


    Contributors:


    Publication date :

    2019-10-01


    Size :

    1296637 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    6DoF Pose Estimation for Industrial Manipulation Based on Synthetic Data

    Brucker, Manuel / Durner, Maximilian / Márton, Zoltán-Csaba et al. | TIBKAT | 2020


    6DoF Pose Estimation for Industrial Manipulation Based on Synthetic Data

    Brucker, Manuel / Durner, Maximilian / Márton, Zoltán-Csaba et al. | Springer Verlag | 2020


    Absolute pose estimation from line correspondences using direct linear transformation

    Přibyl, Bronislav / Zemčík, Pavel / Čadík, Martin | British Library Online Contents | 2017


    Ground Plane Polling for 6DoF Pose Estimation of Objects on the Road

    Rangesh, Akshay / Trivedi, Mohan Manubhai | IEEE | 2020


    Iterative Pose Computation from Line Correspondences

    Christy, S. / Horaud, R. | British Library Online Contents | 1999