In this paper, we provide a survey on automotive surround-view fisheye optics, with an emphasis on the impact of optical artifacts on computer vision tasks in autonomous driving and ADAS. The automotive industry has advanced in applying state-of-the-art computer vision to enhance road safety and provide automated driving functionality. When using camera systems on vehicles, there is a particular need for a wide field of view to capture the entire vehicle’s surroundings, in areas such as low-speed maneuvering, automated parking, and cocoon sensing. However, one crucial challenge in surround-view cameras is the strong optical aberrations of the fisheye camera, which is an area that has received little attention in the literature. Additionally, a comprehensive dataset is needed for testing safety-critical scenarios in vehicle automation. The industry has turned to simulation as a cost-effective strategy for creating synthetic datasets with surround-view camera imagery. We examine different simulation methods (such as model-driven and data-driven simulations) and discuss the simulators’ ability (or lack thereof) to model real-world optical performance. Overall, this paper highlights the optical aberrations in automotive fisheye datasets, and the limitations of optical reality in simulated fisheye datasets, with a focus on computer vision in surround-view optical systems.


    Access

    Download


    Export, share and cite



    Title :

    Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challenges




    Publication date :

    2024-09-01


    Size :

    4894175 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Surround-View Fisheye Camera Perception for Automated Driving: Overview, Survey & Challenges

    Kumar, Varun Ravi / Eising, Ciaran / Witt, Christian et al. | IEEE | 2023

    Free access

    Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challenges

    Kumar, Varun Ravi / Eising, Ciaran / Witt, Christian et al. | ArXiv | 2022

    Free access

    Machine Learning-based Stereo Vision Algorithm for Surround View Fisheye Cameras

    Akita, Tokihiko / Yamauchi, Yuji / Fujiyoshi, Hironobu | IEEE | 2018


    SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround View Fisheye Cameras

    Ravi Kumar, Varun / Klingner, Marvin / Yogamani, Senthil et al. | IEEE | 2022


    Near-Field Perception for Low-Speed Vehicle Automation Using Surround-View Fisheye Cameras

    Eising, Ciaran / Horgan, Jonathan / Yogamani, Senthil | IEEE | 2022