This work proposes a vision-based perception algorithm that combines image-processing-based detection and tracking of aerial objects with convolutional neural networks (CNNs) integrated for classification of general aviation aircraft, multirotor small uncrewed aerial systems (SUAS), fixed-wing SUAS, and birds to enable improved onboard avoidance algorithm decision making. Furthermore, we integrate adversarial learning during the training of the CNNs and evaluate performance with class balanced and imbalanced datasets because this maximizes the utility of resource-expensive flight experiments to collect aviation datasets. We compare our proposed CNN with adversarial learning (CNN+ADVL) model with a state-of-the-art CNN as well as a you only look once (YOLO, v4) model retrained (YOLO v4 aircraft) on the same data. The CNN+ADVL trained on the imbalanced dataset achieves the highest 10-fold cross-validation classification accuracy of 76.2% for aircraft and birds for all ranges while achieving 87.0% aircraft classification accuracy, meeting proposed self-assurance separation distances derived from Federal Aviation Administration (FAA) guidelines. In comparison, the CNNs achieved 74.4% 10-fold cross-validation classification accuracy for aircraft and birds as well as 83.4% accuracy for the aircraft, meeting proposed self-assurance separation distances derived from FAA guidelines. Furthermore, we demonstrate that the integration of adversarial learning improves the classification performance for the perception of aerial objects using a class imbalanced dataset.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adversarial Learning Improves Vision-Based Perception from Drones with Imbalanced Datasets


    Contributors:

    Published in:

    Publication date :

    2023-06-06


    Size :

    19 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Efficient Generative Adversarial Networks for Imbalanced Traffic Collision Datasets

    Chen, Mu-Yen / Chiang, Hsiu-Sen / Huang, Wei-Kai | IEEE | 2022


    DETECTING ADVERSARIAL SAMPLES BY VISION BASED PERCEPTION SYSTEM

    JIA YUNHAN / ZHONG ZHENYU / ZHANG YULONG et al. | European Patent Office | 2020

    Free access

    Bayes classifiers for imbalanced traffic accidents datasets

    Mujalli, Randa Oqab | Online Contents | 2016


    Bayes classifiers for imbalanced traffic accidents datasets

    Mujalli, Randa Oqab / López, Griselda / Garach, Laura | Elsevier | 2015