For a heterogeneous sensor grid to achieve situational awareness over an area of interest and successfully detect, track, classify, and identify (DTCI) objects of interest, individual sensor platforms must be able to autonomously adapt to changing environments by modifying their controllable parameters in real-time. To this end, we propose a novel methodology for active sensor management by means of online reinforcement learning that simultaneously learns an optimal policy and discretizes the state-action space of interest through dictionary learning - learning of a finite set of representative state-action space. This method features minimal a priori assumptions on the state-action space, allowing for gradual adaptation of the policy to occur as a sensor observes new information. The major innovation is the use of dictionary learning to gradually determine the individual basis functions whose linear combination approximates the Q-function. We show in several physics-based photorealistic simulations, based on a real-world test and experimentation location represented in the Gazebo framework, that our methodology is capable of learning near-optimal policies while taking significantly less training time than is traditionally found in other reinforcement learning methods. These simulation results capture performance of several independent sensors monitoring the same area of interest with small amounts of field of view overlap. They set the foundation for future work where sensors interact to coordinate their adaptation to further enhance the resultant situational awareness.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Online Reinforcement Learning for Autonomous Sensor Control


    Contributors:


    Publication date :

    2023-03-04


    Size :

    878667 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multiagent Reinforcement Learning and Game-Theoretic Optimization for Autonomous Sensor Control

    Ravier, Robert / Garagic, Denis / Galoppo, Travis et al. | IEEE | 2024


    AUTONOMOUS SPACECRAFT ATTITUDE CONTROL USING DEEP REINFORCEMENT LEARNING

    Elkins, Jacob / Sood, Rohan / Rumpf, Clemens | TIBKAT | 2021



    Modular Reinforcement Learning for Autonomous UAV Flight Control

    Jongkwan Choi / Hyeon Min Kim / Ha Jun Hwang et al. | DOAJ | 2023

    Free access

    Autonomous Bus Fleet Control Using Multiagent Reinforcement Learning

    Sung-Jung Wang / S. K. Jason Chang | DOAJ | 2021

    Free access