Visual perception stack is indispensable for present-day autonomous vehicle. It perceives the environment around the ego vehicle in the same way as humans. Stereo cameras are the prominent sensor for visual perception stack. This paper will focus on deep-level understanding of visual perception using stereo camera, image processing, and crucial aspects required for autonomous cars. There are other sensors such as LIDAR, GNSS, and IMU, which are used for environment perception, but the information from stereo cameras are far profitable and utilitarian than other sensor information. First, the image formation phenomenon is discussed followed by the image projection onto different frames such as world frame, camera frame, image coordinates, and pixel coordinate. Then camera calibration will be discussed and intrinsic parameters of stereo camera are obtained from RQ factorization method. Depth perception from stereo camera is done by using identifying epipolar line and by arriving at disparity map, depth map, and finally the cross correlation. Then feature detection, feature description, and feature matching are essential in order to establish a robust image detection. The algorithms involved in each part will be discussed along with outlier rejection using RANSAC algorithm. In order to obtain a fine image detection, CNN will be used along with pooling layer and feature decoder to up sample the image. The output of semantic segmentation will be obliging for drivable space estimation, object detection, and distance-to-collision on environment.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Visual Perception Stack for Autonomous Vehicle


    Weitere Titelangaben:

    EAI/Springer Innovations in Communication and Computing


    Beteiligte:
    Naganathan, Archana (Herausgeber:in) / Jayarajan, Niresh (Herausgeber:in) / Bin Ibne Reaz, Mamun (Herausgeber:in) / Benedict, Anthony (Autor:in) / Jayarajan, Niresh (Autor:in) / Srinivasan, Adarsh V. (Autor:in) / Asokar, Sowmiyan (Autor:in)


    Erscheinungsdatum :

    2023-08-24


    Format / Umfang :

    25 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Visual Perception Stack for Autonomous Vehicle Using Semantic Segmentation and Object Detection

    Khanna, Manju / Tiwari, Tarun / Agarwal, Satyam et al. | IEEE | 2021


    AUTONOMOUS VEHICLE OPERATIONAL MANAGEMENT WITH VISUAL SALIENCY PERCEPTION CONTROL

    NODA KUNIAKI / WRAY KYLE HOLLINS / WITWICKI STEFAN | Europäisches Patentamt | 2023

    Freier Zugriff

    Autonomous vehicle operational management with visual saliency perception control

    NODA KUNIAKI / WRAY KYLE HOLLINS / WITWICKI STEFAN | Europäisches Patentamt | 2021

    Freier Zugriff

    Unmanned underwater vehicle autonomous tracking method based on visual perception

    LIU YANCHENG / ZHU PENGLI / DONG ZHANGWEI et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Visual perception method, apparatus, device, and medium based on an autonomous vehicle

    CHEN JIAJIA / WAN JI / XIA TIAN | Europäisches Patentamt | 2021

    Freier Zugriff