This paper proposes an active information-directed reinforcement learning (AID-RL) framework for autonomous source seeking and estimation problem. Source seeking requires the search agent to move towards the true source, and source estimation demands the agent to maintain and update its knowledge regarding the source properties such as release rate and source position. These two objectives give rise to the newly developed framework, namely, dual control for exploration and exploitation. In this paper, the greedy RL forms an exploitation search strategy that navigates the agent to the source position, while the information-directed search commands the agent to explore most informative positions to reduce belief uncertainty. Extensive results are presented using a high-fidelity dataset for autonomous search, which validates the effectiveness of the proposed AID-RL and highlights the importance of active exploration in improving sampling efficiency and search performance.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    AID-RL: Active information-directed reinforcement learning for autonomous source seeking and estimation


    Beteiligte:
    Li, Z (Autor:in) / Chen, WH (Autor:in) / Yang, J (Autor:in) / Yan, Y (Autor:in)

    Erscheinungsdatum :

    2023-08-01


    Anmerkungen:

    Neurocomputing , 544 , Article 126281. (2023) (In press).


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Multi-Agent Navigation with Reinforcement Learning Enhanced Information Seeking

    Zhang, Siwei / Guerra, Anna / Guidi, Francesco et al. | Deutsches Zentrum für Luft- und Raumfahrt (DLR) | 2022

    Freier Zugriff


    Robust source-seeking hybrid controllers for autonomous vehicles

    Mayhew, C.G. / Sanfelice, R.G. / Teel, A.R. | Tema Archiv | 2007


    Autonomous robotic nanofabrication with reinforcement learning

    Leinen, Philipp / Esders, Malte / Schütt, Kristof T. et al. | BASE | 2020

    Freier Zugriff

    Reinforcement Learning for Autonomous Aircraft Avoidance

    Keong, Choo Wai / Shin, Hyo-Sang / Tsourdos, Antonios | IEEE | 2019