Understanding ego-motion and surrounding vehicle state is essential to enable automated driving and advanced driving assistance technologies. Typical approaches to solve this problem use fusion of multiple sensors such as LiDAR, camera, and radar to recognize surrounding vehicle state, including position, velocity, and orientation. Such sensing modalities are overly complex and costly for production of personal use vehicles. In this paper, we propose a novel machine learning method to estimate ego-motion and surrounding vehicle state using a single monocular camera. Our approach is based on a combination of three deep neural networks to estimate the 3D vehicle bounding box, depth, and optical flow from a sequence of images. The main contribution of this paper is a new framework and algorithm that integrates these three networks in order to estimate the ego-motion and surrounding vehicle state. To realize more accurate 3D position estimation, we address ground plane correction in real-time. The efficacy of the proposed method is demonstrated through experimental evaluations that compare our results to ground truth data available from other sensors including Can-Bus and LiDAR.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Ego-motion and Surrounding Vehicle State Estimation Using a Monocular Camera


    Contributors:


    Publication date :

    2019-06-01


    Size :

    1163405 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    EGO-MOTION AND SURROUNDING VEHICLE STATE ESTIMATION USING A MONOCULAR CAMERA

    Hayakawa, Jun / Dariush, Behzad | British Library Conference Proceedings | 2019


    A Field-Based Representation of Surrounding Vehicle Motion from a Monocular Camera

    Zhu, Lifeng / Li, Xuanpeng / Lu, Wenjie et al. | IEEE | 2018


    A FIELD-BASED REPRESENTATION OF SURROUNDING VEHICLE MOTION FROM A MONOCULAR CAMERA

    Zhu, Lifeng / Li, Xuanpeng / Lu, Wenjie et al. | British Library Conference Proceedings | 2018


    Robust Estimation of Vehicle Ego-motion for Monocular Camera System

    Koitabashi, H. / Iketani, T. / Murata, Y. et al. | British Library Conference Proceedings | 2008


    Vehicle speed estimation using a monocular camera [9407-3]

    British Library Conference Proceedings | 2015