Target-driven visual navigation presents great potentials in scientific and industrial fields. It takes the target and environment observations as input. However, during training, we found that the agent sometimes got stuck in specific locations. Based on the analysis on visual information from a novel causal perspective, one of the most critical hurdles is the neglect of confounders in environments, which often leads to spurious correlations. Mitigating the confounding effect helps to discover the real causality and therefore are taken into consideration in other fields such as object detection. In this article, we propose Causal Intervention Visual Navigation (CIVN), based on deep reinforcement learning (DRL) and causal intervention. We realize causal intervention using front-door adjustment as most confounders are hard to model explicitly. Specifically, CIVN is implemented by Causal Attention, which is a reasonable approximation of causal intervention for visual navigation. Causal attention provides high-quality representation, which is leveraged by DRL and reduces the number of “stuck”. It is worth mentioned that causal intervention is for the first time applied by us in solving the confounding effect in target-driven visual navigation. Extensive experiments on AI2-THOR demonstrate that CIVN achieves better performance than prior arts. Specifically, the generalization for unknown targets and scenes is improved by a large margin, which is a basic research topic in visual navigation. Moreover, to obtain better generalization, we propose a novel experiment utilizing pre-trained models firstly.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Target-Driven Visual Navigation by Using Causal Intervention


    Beteiligte:
    Zhao, Xinzhou (Autor:in) / Wang, Tian (Autor:in) / Li, Yanjing (Autor:in) / Zhang, Baochang (Autor:in) / Liu, Kexin (Autor:in) / Liu, Deyuan (Autor:in) / Wang, Chuanyun (Autor:in) / Snoussi, Hichem (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2024-01-01


    Format / Umfang :

    2010572 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    NAVIGATION USING SELECTED VISUAL LANDMARKS

    KERZNER DANIEL TODD / SEYFI AHMAD / MEYER TIMON et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    NAVIGATION USING SELECTED VISUAL LANDMARKS

    KERZNER DANIEL TODD / REZVANI BABAK / TOURNIER GLENN et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Navigation using selected visual landmarks

    KERZNER DANIEL TODD / SEYFI AHMAD / MEYER TIMON et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    AUTONOMOUS NAVIGATION USING VISUAL ODOMETRY

    LIAO MIAO / LI MING / HONG SOONHAC | Europäisches Patentamt | 2017

    Freier Zugriff

    VISUAL REINFORCEMENT NAVIGATION

    GIDEON STEIN | Europäisches Patentamt | 2019

    Freier Zugriff