In order to improve usability and safety, modern unmanned aerial vehicles (UAVs) are equipped with sensors to monitor the environment, such as laser-scanners and cameras. One important aspect in this monitoring process is to detect obstacles in the flight path in order to avoid collisions. Since a large number of consumer UAVs suffer from tight weight and power constraints, our work focuses on obstacle avoidance based on a lightweight stereo camera setup. We use disparity maps, which are computed from the camera images, to locate obstacles and to automatically steer the UAV around them. For disparity map computation we optimize the well-known semi-global matching (SGM) approach for the deployment on an embedded FPGA. The disparity maps are then converted into simpler representations, the so called U-/V-Maps, which are used for obstacle detection. Obstacle avoidance is based on a reactive approach which finds the shortest path around the obstacles as soon as they have a critical distance to the UAV. One of the fundamental goals of our work was the reduction of development costs by closing the gap between application development and hardware optimization. Hence, we aimed at using high-level synthesis (HLS) for porting our algorithms, which are written in C/C++, to the embedded FPGA. We evaluated our implementation of the disparity estimation on the KITTI Stereo 2015 benchmark. The integrity of the overall real-time reactive obstacle avoidance algorithm has been evaluated by using Hardware-in-the-Loop testing in conjunction with two flight simulators.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Real-Time On-Board Obstacle Avoidance for UAVs based on Embedded Stereo Vision


    Beteiligte:

    Erscheinungsdatum :

    2018-10-15


    Anmerkungen:

    The international archives of photogrammetry, remote sensing and spatial information sciences, XLII-1, 363–370 ; ISSN: 1682-1750



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    550 / 629




    Real-time on-board obstacle avoidance for UAVs based on embedded stereo vision

    Ruf, B. / Monka, S. / Kollmann, Matthias et al. | BASE | 2018

    Freier Zugriff

    Vision-Based Obstacle Avoidance for UAVs

    Watanabe, Yoko / Calise, Anthony / Johnson, Eric | AIAA | 2007


    Vision-Based Obstacle Avoidance for UAVs AIAA Paper

    Watanabe, Y. / Calise, A. / Johnson, E. | British Library Conference Proceedings | 2007


    Obstacle avoidance for small UAVs using monocular vision

    Lee, Jeong-Oog / Lee, Keun-Hwan / Park, Sang-Heon et al. | Emerald Group Publishing | 2011


    Obstacle avoidance for small UAVs using monocular vision

    Lee, Jeong-Oog | Online Contents | 2011