This paper proposes an active information-directed reinforcement learning (AID-RL) framework for autonomous source seeking and estimation problem. Source seeking requires the search agent to move towards the true source, and source estimation demands the agent to maintain and update its knowledge regarding the source properties such as release rate and source position. These two objectives give rise to the newly developed framework, namely, dual control for exploration and exploitation. In this paper, the greedy RL forms an exploitation search strategy that navigates the agent to the source position, while the information-directed search commands the agent to explore most informative positions to reduce belief uncertainty. Extensive results are presented using a high-fidelity dataset for autonomous search, which validates the effectiveness of the proposed AID-RL and highlights the importance of active exploration in improving sampling efficiency and search performance.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    AID-RL: Active information-directed reinforcement learning for autonomous source seeking and estimation


    Beteiligte:
    Li, Z (Autor:in) / Chen, WH (Autor:in) / Yang, J (Autor:in) / Yan, Y (Autor:in)

    Erscheinungsdatum :

    2023-08-01


    Anmerkungen:

    Neurocomputing , 544 , Article 126281. (2023) (In press).


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Multi-Agent Navigation with Reinforcement Learning Enhanced Information Seeking

    Zhang, Siwei / Guerra, Anna / Guidi, Francesco et al. | Deutsches Zentrum für Luft- und Raumfahrt (DLR) | 2022

    Freier Zugriff


    Robust source-seeking hybrid controllers for autonomous vehicles

    Mayhew, C.G. / Sanfelice, R.G. / Teel, A.R. | Tema Archiv | 2007


    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023


    REINFORCEMENT LEARNING FOR AUTONOMOUS LANE CHANGE

    SHI ZHAN / JIANG YIFEI / LI ANG | Europäisches Patentamt | 2024

    Freier Zugriff