Deep neural networks have demonstrated their capability to learn control policies for a variety of tasks. However, these neural network-based policies have been shown to be susceptible to exploitation by adversarial agents. Therefore, there is a need to develop techniques to learn control policies that are robust against adversaries. We introduce Adversarially Robust Control (ARC), which trains the protagonist policy and the adversarial policy end-to-end on the same loss. The aim of the protagonist is to maximise this loss, whilst the adversary is attempting to minimise it. We demonstrate the proposed ARC training in a highway driving scenario, where the protagonist controls the follower vehicle whilst the adversary controls the lead vehicle. By training the protagonist against an ensemble of adversaries, it learns a significantly more robust control policy, which generalises to a variety of adversarial strategies. The approach is shown to reduce the amount of collisions against new adversaries by up to 90.25%, compared to the original policy. Moreover, by utilising an auxiliary distillation loss, we show that the fine-tuned control policy shows no drop in performance across its original training distribution.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    ARC: Adversarially Robust Control Policies for Autonomous Vehicles


    Beteiligte:
    Kuutti, Sampo (Autor:in) / Fallah, Saber (Autor:in) / Bowden, Richard (Autor:in)


    Erscheinungsdatum :

    19.09.2021


    Format / Umfang :

    443821 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Verification of Adversarially Robust Reinforcement Learning Mechanisms in Aerospace Systems

    Seo, Taehwan / Sahoo, Prachi P. / Vamvoudakis, Kyriakos G. | TIBKAT | 2023


    Verification of Adversarially Robust Reinforcement Learning Mechanisms in Aerospace Systems

    Seo, Taehwan / Sahoo, Prachi P. / Vamvoudakis, Kyriakos G. | AIAA | 2023


    Policies in the Era of Autonomous Vehicles

    Russell Anjos, Liam Luciano | BASE | 2023

    Freier Zugriff

    Robust Path Tracking Control for Autonomous Heavy Vehicles

    Wang, Haoan / Guvenc, Levent / Zhang, Wenming et al. | SAE Technical Papers | 2018


    Robust Path Tracking Control for Autonomous Heavy Vehicles

    Gao, Yu / Shen, Yanhua / Zhang, Wenming et al. | British Library Conference Proceedings | 2018