As the core technology of an environmental perception system, object detection has received more and more attention and has become a hot research direction for intelligent driving vehicles. The CNN–Transformer hybrid model has poor generalization ability, making it difficult to meet the detection requirements for small objects in complex scenes. We propose a novel convolutional neural network (CNN)–Transformer Adaptive Feature Fusion Network (CTAFFNet) for object detection. First, we design a Local–Global Feature Fusion unit known as the Convolutional Transformation Adaptive Fusion Kernel (CTAFFK), which is integrated into CTAFFNet. The CTAFFK kernel utilizes two branches, namely CNN and Transformer, to extract local and global features from the image, and adaptively fuses the features from both branches. Subsequently, we develop an adaptive feature fusion strategy that combines local high-frequency and global low-frequency features to obtain comprehensive feature information. Finally, CTAFFNet employs an encoder–decoder structure to facilitate the flow of fused local–global information between different stages, ensuring the model’s generalization capabilities. Results from the experiment conducted on the large and challenging KITTI dataset demonstrate the effectiveness and efficiency of the proposed network. Compared with other mainstream networks, it achieves an average precision of 91.17%, particularly excelling in the detection of small objects at longer distances with a remarkable 70.18% accuracy, while also providing real-time detection capabilities.


    Zugriff

    Download

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    CTAFFNet: CNN–Transformer Adaptive Feature Fusion Object Detection Algorithm for Complex Traffic Scenarios


    Weitere Titelangaben:

    Transportation Research Record: Journal of the Transportation Research Board


    Beteiligte:
    Dong, Xinlong (Autor:in) / Shi, Peicheng (Autor:in) / Liang, Taonian (Autor:in) / Yang, Aixi (Autor:in)


    Erscheinungsdatum :

    09.09.2024




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Object Detection for Self-Driving Car in Complex Traffic Scenarios

    Das Biplab / Agrawal Pooja | DOAJ | 2024

    Freier Zugriff


    Object Detection in Maritime Scenarios Based on Swin-Transformer

    Sun, Wenli / Gao, Xu | Springer Verlag | 2022


    Multimodal target detection algorithm based on adaptive feature fusion

    Li, Yitong / He, Chuchao / Di, Ruohai et al. | SPIE | 2024


    Improved Kmeans Algorithm for Detection in Traffic Scenarios

    Chen, Guang / Liu, Xiangyong | SAE Technical Papers | 2019