Highway abandoned objects have seriously threatened traffic safety, which may lead to vehicle crashes and block roadways. It is significant for transportation agencies to recognize and clear them as soon as possible. However, it is challenging to detect these abandoned objects because they have various sizes/categories and appear at different locations. Although computer-vision-based object detection algorithms have succeeded in traffic monitoring and autonomous driving, most SOTA algorithms cannot satisfy the demand for highway abandoned object detection due to undetermined target categories. Inspired by impressive progress in contrastive learning and large language models, this paper proposes a two-stage open-vocabulary object detection algorithm for highway abandoned object detection. The first stage is the region proposal, with the pre-trained image encoder presenting all region candidates on multiple scales. Then, the second stage adopts CLIP and computes similarities of embeddings from proposed regions. In contrast to conventional object detection algorithms, this algorithm is not constrained by limited training data categories. The proposed algorithm is validated using real-world highway surveillance videos collected in Nanjing, China, containing varying light conditions and multiple video angles. Compared with SOTA object detection models, the proposed one has shown extraordinary performance and generalization abilities for abandoned object detection, with higher precision and running efficiency, that is, in low-light conditions. This approach is helpful for transportation agencies to provide early warning in time and find accident perpetrators.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Highway Abandoned Objects Recognition Based on Open Vocabulary Object Detection Approach


    Beteiligte:
    Liu, Siwen (Autor:in) / Zhuang, Yifan (Autor:in) / Zheng, Nanfang (Autor:in) / Ji, Yufei (Autor:in) / Liu, Pei (Autor:in) / Pu, Ziyuan (Autor:in)

    Kongress:

    International Conference on Transportation and Development 2024 ; 2024 ; Atlanta, Georgia



    Erscheinungsdatum :

    13.06.2024




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Handwritten address recognition with open vocabulary using character n-grams

    Brakensiek, A. / Rottland, J. / Rigoll, G. | IEEE | 2002


    Handwritten Address Recognition with Open Vocabulary Using Character N-Grams

    Brakensiek, A. / Rottland, J. / Rigoll, G. | British Library Conference Proceedings | 2002


    Research on the lightweight detection network of abandoned objects in freeway based on video

    Liu, Wenjun / Li, Jian / Liu, Yipeng et al. | British Library Conference Proceedings | 2023


    Abandoned object identification and detection system for railways in India

    Arora, Pankit / Dhar, Akshath / Singh, Tushar et al. | IEEE | 2017