The traditional digital image processing algorithms and Convolutional Neural Network (CNN) models cannot reach the ideal level in the accuracy of asphalt pavement crack image screening. We introduce Vision Transformer (ViT), a Transformer-based method for automatic classification of asphalt pavement images. ViT consists of linear projection layer, embedding layer, transformer block and MLP head layer. To verify the ability of ViT on the crack image screening task, we use asphalt pavement datasets from two sources, and use a transfer learning-based strategy to fine-tune the model after obtaining the weights pre-trained by ViT on the ImageNet dataset. The performance of the ViT model is compared with three popular deep learning models, in which ViT achieves 98.5% accuracy and 99.2% F1 Score on the self-collected asphalt complex pavement dataset. The results showed that ViT and its variants performed better than the classical CNN network Resnet50 in the task of screening asphalt pavement cracks. The image screening method of asphalt pavement cracks based on Transformer performs well and has good research prospects.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Asphalt Pavement Crack Image Screening by Transformer-Based Model


    Contributors:
    Ziwei, Wang (author) / Jun, Feng (author) / Tian, Zhang (author)


    Publication date :

    2022-07-01


    Size :

    763458 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Mathematical Morphology Based Asphalt Pavement Crack Detection

    Wei, Na / Zhao, Xiangmo / Wang, Tao et al. | ASCE | 2009


    Mathematical Morphology Based Asphalt Pavement Crack Detection

    Wei, N. / Zhao, X. / Wang, T. et al. | British Library Conference Proceedings | 2009


    Development of a Laboratory Screening Test for Asphalt Pavement Crack Sealants

    Van Dam, Thomas J. / Reay, Scott / Appleyard, Marcy et al. | Transportation Research Record | 1999


    Asphalt Pavement Health Prediction Based on Improved Transformer Network

    Han, Chengjia / Ma, Tao / Gu, Linhao et al. | IEEE | 2023