The success of deep neural networks (DNNs) has led to its increased deployment in various real-world applications, which provides strong incentives for motivated adversaries to manipulate the results and models generated by these algorithms. We present an automated, physically-realizable, dynamic adversarial attack to compromise an end-to-end trained DNN controlled autonomous vehicle. The attack is initiated by installing a billboard displaying videos on the roadside to incoming DNN controlled vehicles so that the vehicle tracks an adversary customized trajectory. The billboard contains an integrated camera to enable estimation of the pose of the approaching vehicle. The dynamic billboard images (i.e., a video) continuously adapt to the vehicle’s relative pose with respect to the billboard while being robust to variations in lighting, view angle, and weather. The attack’s effectiveness is shown on a recently developed off-the-shelf high-fidelity simulator, CARLA, for autonomous vehicles. CARLA utilizes an end-to-end learning-based autonomous navigation system. The proposed approach is applicable to other end-to-end trained autonomous cyber-physical systems.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Overriding Autonomous Driving Systems Using Adaptive Adversarial Billboards


    Contributors:


    Publication date :

    2022-08-01


    Size :

    4830098 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Attentive billboards

    Haritaoglu, I. / Flickner, M. | IEEE | 2001


    Attentive Billboards

    Haritaoglu, I. / Flickner, M. / IEEE | British Library Conference Proceedings | 2001


    SYSTEMS AND METHODS FOR OVERRIDING AUTONOMOUS CONTROL OF A DEVICE

    PLASS CHRISTOPHER E / CALLAHAN KEVIN S | European Patent Office | 2024

    Free access

    Systems and methods for overriding autonomous control of a device

    PLASS CHRISTOPHER E / CALLAHAN KEVIN S | European Patent Office | 2024

    Free access

    Systems and Methods for Overriding Autonomous Control of a Device

    PLASS CHRISTOPHER E / CALLAHAN KEVIN S | European Patent Office | 2022

    Free access