Abstract: The safety assessment of cyber-physical systems (CPSs) requires tremendous effort, as the complexity of cyber-physical systems is increasing. A well-known approach for the safety assessment of CPSs is fault injection (FI). The goal of fault injection is to find a catastrophic fault that can cause the system to fail by injecting faults into it. These catastrophic faults are less likely to occur, and finding them requires tremendous labor and cost. In this study, we propose a reinforcement learning (RL)-based method to automatically configure faults in the system under test and to find catastrophic faults in the early stage of system development at the model level. The proposed method provides a guideline to utilize high-level domain knowledge about a system model for constructing the reinforcement learning agent and fault injection setup. In this study, we used the system (safety) specification to shape the reward function in the reinforcement learning agent. The reinforcement learning agent dynamically interacted with the model under test to identify catastrophic faults. We compared the proposed method with random-based fault injection in two case studies using MATLAB/Simulink. Our proposed method outperformed random-based fault injection in terms of the severity and number of faults found.


    Access

    Download


    Export, share and cite



    Title :

    Failure identification using model-implemented fault injection with domain knowledge-guided reinforcement learning


    Contributors:

    Publication date :

    2023-01-01


    Remarks:

    1424-8220 ; Sensors


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    SDR – Self Driving Car Implemented using Reinforcement Learning & Behavioural Cloning

    Tippannavar, Sanjay S / S D, Yashwanth / K M, Puneeth | IEEE | 2023


    Relational reinforcement learning with guided demonstrations

    Martínez Martínez, David / Alenyà Ribas, Guillem / Torras, Carme | BASE | 2017

    Free access

    Temporal Logic Guided Safe Model-Based Reinforcement Learning

    Cohen, Max / Belta, Calin | Springer Verlag | 2023


    IDENTIFICATION OF TRANSPORT MODES OF COMMUTERS VIA UNSUPERVISED LEARNING IMPLEMENTED USING MULTISTAGE LEARNER WITH DOMAIN GENERALIZATION

    BANDYOPADHYAY SOMA / PAL ARPAN / RAMAKRISHNAN RAMESH KUMAR et al. | European Patent Office | 2024

    Free access

    Robust Driving Policy Learning with Guided Meta Reinforcement Learning

    Lee, Kanghoon / Li, Jiachen / Isele, David et al. | IEEE | 2023