This study investigates the use of deep reinforcement learning for active noise control (DRL-ANC) to cancel narrowband noise. The filtered-x least mean square algorithm for ANC, which includes the secondary path model in itself, has been widely used in various applications. If the path model is inaccurate due to the variations of the actual path, control performance and stability of the algorithm can be restricted. To eliminate the effect by the model inaccuracy, it is considered to remove the path model in the novel DRL-ANC strategy. A DRL approach using the deep deterministic policy gradient without any path model is adopted to learn the behavior of a physical environment including the effect of the actual secondary path in real time. However, a temporal credit assignment problem arises due to the time-delayed reward inherent in the secondary path, which means that the current action could not be evaluated by its true. To address this problem, this study proposes a novel definitions of the state and action of the RL agent, specialized in narrowband noise suppression. Additionally, a novel exploration noise is also suggested to enhance effectiveness and practicality of the learning process. Computer simulations and real-time control experiments were conducted, and the results demonstrated that the proposed DRL-ANC algorithm can robustly cope with changes in the secondary path.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Narrowband Active Noise Control with DDPG Based on Reinforcement Learning


    Weitere Titelangaben:

    Int.J Automot. Technol.


    Beteiligte:
    Ryu, Seokhoon (Autor:in) / Lim, Jihea (Autor:in) / Lee, Young-Sup (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.12.2024


    Format / Umfang :

    9 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Narrowband Active Noise Control with DDPG Based on Reinforcement Learning

    Ryu, Seokhoon / Lim, Jihea / Lee, Young-Sup | Springer Verlag | 2024


    AEB control method and system based on DDPG deep reinforcement learning

    SHI JUNREN / LI KEXIN / PARK CHANG HO et al. | Europäisches Patentamt | 2022

    Freier Zugriff


    Unmanned Vehicle Path Planning Based on DDPG Reinforcement Learning Algorithm in Forest Land Environment

    Li, Luhao / Li, Yongliang / Du, Miaomiao et al. | Springer Verlag | 2025


    Quadcopter UAV attitude control based on DDPG

    HUANG Xijie | DOAJ | 2024

    Freier Zugriff