In this paper, we propose a method to recognize semantic and geometric structure of a traffic scene using monocular cameras. We designed Deep Neural Networks (DNNs) for semantic segmentation and depth estimation and trained them using data collected with a test vehicle, on top of which a 360degree panoramic camera system and a LIDAR are mounted. Collected images were manually annotated for semantic segmentation. Experimental results show that the trained DNNs can accurately classify each pixel and also accurately estimate depth of each pixel of images in validation data. Global average of semantic segmentation reached 96.4%, while overall accuracy of depth estimation was 88.7%. Generalization capability for both tasks was also tested with DNNs trained only with front facing camera images, resulting that semantic segmentation and depth estimation were successfully executed at slightly less accuracy. We also developed a novel interface using a head mount display, that enables us to evaluate results of estimation intuitively for checking how well the estimation of proposed DNNs is.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Understanding 3D Semantic Structure around the Vehicle with Monocular Cameras


    Contributors:


    Publication date :

    2018-06-01


    Size :

    3866986 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    UNDERSTANDING 3D SEMANTIC STRUCTURE AROUND THE VEHICLE WITH MONOCULAR CAMERAS

    Narioka, Kenichi / Nishimura, Hiroki / Itamochi, Takayuki et al. | British Library Conference Proceedings | 2018




    Multi-body motion estimation from monocular vehicle-mounted cameras

    Sabzevari, Reza / Scaramuzza, Davide | BASE | 2016

    Free access

    Detecting parallel moving vehicles with monocular omnidirectional side cameras

    Schueler, Kai / Raaijmakers, Marvin / Neumaier, Stephan et al. | IEEE | 2013