As the core technology of an environmental perception system, object detection has received more and more attention and has become a hot research direction for intelligent driving vehicles. The CNN–Transformer hybrid model has poor generalization ability, making it difficult to meet the detection requirements for small objects in complex scenes. We propose a novel convolutional neural network (CNN)–Transformer Adaptive Feature Fusion Network (CTAFFNet) for object detection. First, we design a Local–Global Feature Fusion unit known as the Convolutional Transformation Adaptive Fusion Kernel (CTAFFK), which is integrated into CTAFFNet. The CTAFFK kernel utilizes two branches, namely CNN and Transformer, to extract local and global features from the image, and adaptively fuses the features from both branches. Subsequently, we develop an adaptive feature fusion strategy that combines local high-frequency and global low-frequency features to obtain comprehensive feature information. Finally, CTAFFNet employs an encoder–decoder structure to facilitate the flow of fused local–global information between different stages, ensuring the model’s generalization capabilities. Results from the experiment conducted on the large and challenging KITTI dataset demonstrate the effectiveness and efficiency of the proposed network. Compared with other mainstream networks, it achieves an average precision of 91.17%, particularly excelling in the detection of small objects at longer distances with a remarkable 70.18% accuracy, while also providing real-time detection capabilities.


    Access

    Download

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    CTAFFNet: CNN–Transformer Adaptive Feature Fusion Object Detection Algorithm for Complex Traffic Scenarios


    Additional title:

    Transportation Research Record: Journal of the Transportation Research Board


    Contributors:
    Dong, Xinlong (author) / Shi, Peicheng (author) / Liang, Taonian (author) / Yang, Aixi (author)


    Publication date :

    2024-09-09




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Object Detection for Self-Driving Car in Complex Traffic Scenarios

    Das Biplab / Agrawal Pooja | DOAJ | 2024

    Free access


    Object Detection in Maritime Scenarios Based on Swin-Transformer

    Sun, Wenli / Gao, Xu | Springer Verlag | 2022


    Multimodal target detection algorithm based on adaptive feature fusion

    Li, Yitong / He, Chuchao / Di, Ruohai et al. | SPIE | 2024


    Improved Kmeans Algorithm for Detection in Traffic Scenarios

    Chen, Guang / Liu, Xiangyong | SAE Technical Papers | 2019