Radar countermeasure (RCM) is increasingly important in modern warfare. Fast and accurate jamming decision made by RCM systems can provide timely electronic protection for important or high-value targets. To quickly find a jamming policy against the multifunctional radar, a jamming policy generation scheme via heuristic programming reinforcement learning is proposed in this article, where the jamming strategy can be dynamically adjusted using interactive self-learning. First, the relationships between radar operation modes and jamming modes are investigated under self-defense jamming in an air-to-air RCM scenario, which is modeled as a Markov decision process. Especially, the potential energy is employed to construct a heuristic reward function that avoids the jammer getting stuck in the local jamming action space. In addition, a model relating to radar state transition is derived using the real experience from the jammer–radar interaction, which narrows the state-action space. The simulated experience programmed by this model can accelerate to update the value function. The proposed method decreases sample complexity while increasing sample utilization, reducing the time for jamming decision-making. Numerical experimental results demonstrate that the proposed method has superior jamming decision performance compared with prevailing methods, effectively improving the real-time performance and interference effectiveness of RCM systems.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Jamming Policy Generation via Heuristic Programming Reinforcement Learning


    Contributors:
    Zhang, Yujie (author) / Huo, Weibo (author) / Huang, Yulin (author) / Zhang, Cui (author) / Pei, Jifang (author) / Zhang, Yin (author) / Yang, Jianyu (author)


    Publication date :

    2023-12-01


    Size :

    3816003 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Flexible Heuristic Dynamic Programming for Reinforcement Learning in Quad-Rotors

    Helmer, Alexander / de Visser, Coen C. / Van Kampen, Erik-Jan | AIAA | 2018


    Flexible Heuristic Dynamic Programming for Reinforcement Learning in Quad-Rotors (AIAA 2018-2134)

    Helmer, Alexander / de Visser, Coen C. / Van Kampen, Erik-Jan | British Library Conference Proceedings | 2018


    Reinforcement Learning Based Jamming Detection for Reliable Wireless Communications

    Wang, Chen / Chen, Yifan / Lin, Zhiping et al. | IEEE | 2024


    An Algorithm for Jamming Decision Using Dual Reinforcement Learning

    Zhuansun, Shaoshuai / Yang, Junan / Liu, Hui et al. | British Library Online Contents | 2018