Fisheye cameras are widely employed in automatic parking, and the video stream object detection (VSOD) of the fisheye camera is a fundamental perception function to ensure the safe operation of vehicles. In past research, the difference between the output of the deep learning model and the actual situation at the current moment due to the existence of delay of the perception system is generally ignored. Nevertheless, the environment will inevitably change within the delay, which may cause a potential safety hazard. This paper proposes a real-time detection framework with a dual-flow perception module (dynamic and static flows) that can predict the future and alleviate the time-lag problem. Meanwhile, we use a new scheme to evaluate latency and accuracy. The standard bbox is unsuitable for the object in fisheye camera images due to the solid radial distortion of the fisheye camera. The primary detection objects of parking perception are vehicles and pedestrians, so we adopt the rotated bbox and propose a new periodic angle loss function to regress the angle of the box, which is the simple and accurate representation method of objects. The instance segmentation ground truth is used to supervise the training. Experiments demonstrate the effectiveness of our approach. Code is released at: https://gitee.com/hiyanyx/fisheye-streaming-perception.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Streaming Object Detection on Fisheye Cameras for Automatic Parking


    Weitere Titelangaben:

    Lect. Notes Electrical Eng.


    Beteiligte:
    Yan, Yixiong (Autor:in) / Cheng, Liangzhu (Autor:in) / Li, Yongxu (Autor:in) / Tuo, Xinjuan (Autor:in) / Huang, Baoqiang (Autor:in) / Zhu, Yakun (Autor:in)

    Kongress:

    Society of Automotive Engineers (SAE)-China Congress ; 2023 ; Shanghai, China October 25, 2023 - October 27, 2023



    Erscheinungsdatum :

    2024-02-21


    Format / Umfang :

    19 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Optimization of a CNN-based Object Detector for Fisheye Cameras

    Goodarzi, Payam / Stellmacher, Martin / Paetzold, Michael et al. | IEEE | 2019


    Road-line detection and 3D reconstruction using fisheye cameras

    Boutteau, R. / Savatier, X. / Bonardi, F. et al. | IEEE | 2013



    VEHICLE LANE MARKING AND OTHER OBJECT DETECTION USING SIDE FISHEYE CAMERAS AND THREE-FOLD DE-WARPING

    WALLIN ANDREAS / DING SIHAO | Europäisches Patentamt | 2020

    Freier Zugriff

    EgoCap:egocentric marker-less motion capture with two fisheye cameras

    Rhodin, Helge / Richardt, Christian / Casas, Dan et al. | BASE | 2016

    Freier Zugriff