Recent years, autonomous drones have attracted attention in many fields due to their convenience. Autonomous drones require precise depth information so as to avoid collision to fly fast and both of RGB image and LiDAR point cloud are often employed in applications based on Convolutional Neural Networks (CNNs) to estimate the distance to obstacles. Such applications are implemented onboard embedded systems. In order to precisely estimate the depth, such CNN models are in general so complex to extract many features that the computational complexity increases, requiring long inference time. In order to solve the issue, we employ optical flow to aid in-depth estimation. In addition, we propose a new attention structure that makes maximum use of optical flow without complicating the network. Furthermore, we achieve improved performance without modifying the depth estimator by adding a perceptual discriminator in training. The proposed model is evaluated through accuracy, error, and inference time on the KITTI dataset. In the experiments, we have demonstrated the proposed method achieves better performance by up to 34% accuracy, 55% error reduction and 66% faster inference time on Jetson nano compared to previous methods. The proposed method is also evaluated through a collision avoidance in simulated drone flight and achieves the lowest collision rate of all estimation methods. These experimental results show the potential of proposed method to be used in real-world autonomous drone flight applications.


    Access

    Download


    Export, share and cite



    Title :

    Fast and High-Quality Monocular Depth Estimation with Optical Flow for Autonomous Drones


    Contributors:


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Monocular depth estimation

    European Patent Office | 2021

    Free access

    Monocular Visual Autonomous Landing System for Quadcopter Drones Using Software in the Loop

    Saavedra-Ruiz, Miguel / Pinto-Vargas, Ana Maria / Romero-Cano, Victor | IEEE | 2022


    Sparse Pseudo-LiDAR Depth Assisted Monocular Depth Estimation

    Shao, Shuwei / Pei, Zhongcai / Chen, Weihai et al. | IEEE | 2024


    Obstacle Avoidance of Monocular Quadrotors with Depth Estimation

    Liu, Qi / Zhang, Zhenghong / Xiong, Mingkang et al. | Springer Verlag | 2022


    Monocular Depth Estimation Using Information Exchange Network

    Su, Wen / Zhang, Haifeng / Zhou, Quan et al. | IEEE | 2021