This paper describes a super-sensor that enables 360-degree environment perception for automated vehicles in urban traffic scenarios. We use four fisheye cameras, four 360-degree LIDARs and a GPS/IMU sensor mounted on an automated vehicle to build a super-sensor that offers an enhanced low-level representation of the environment by harmonizing all the available sensor measurements. Individual sensors cannot provide a robust 360-degree perception due to their limitations: field of view, range, orientation, number of scanning rays, etc. The novelty of this work consists of segmenting the 3D LIDAR point cloud by associating it with the 2D image semantic segmentation. Another contribution is the sensor configuration that enables 360-degree environment perception. The following steps are involved in the process: calibration, timestamp synchronization, fisheye image unwarping, motion correction of LIDAR points, point cloud projection onto the images and semantic segmentation of images. The enhanced low-level representation will improve the high-level perception environment tasks such as object detection, classification and tracking.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Super-sensor for 360-degree environment perception: Point cloud segmentation using image features


    Contributors:


    Publication date :

    2017-10-01


    Size :

    709451 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    IMPROVING LIDAR POINT CLOUD SEGMENTATION USING BOX PREDICTION

    ZHOU LUBING / MENG XIAOLI / SHETTI KARAN RAJENDRA | European Patent Office | 2022

    Free access

    Accident report and storage method based on perception sensor in cloud environment

    LIN MIAO / SONG YAHAO / DAI BING et al. | European Patent Office | 2022

    Free access

    Model based multi sensor 360 degree object perception

    Schüler, Kai / Technische Universität München | TIBKAT | 2015



    Vehicle Detection and Localization using 3D LIDAR Point Cloud and Image Semantic Segmentation

    Barea, Rafael / Perez, Carlos / Bergasa, Luis M. et al. | IEEE | 2018