Piping systems operating under various conditions may cause extremely unstable structural stress and deformation, leading to permanent deformation and damage to the piping structure, bringing about serious safety problems. So, piping stress analysis shall be performed along with proper design. Meanwhile, structural instability due to local stress concentration, which is one of the main interests of stress analysis, can be resolved through the appropriate selection of constraint conditions of piping supports at a relatively low cost. However, selecting an appropriate combination of constraints is time-consuming because analysis results are derived through many iterations. In addition, there is a big difference in the quality of the final design according to the experiences and capabilities of engineers. As a solution to this situation, this paper introduces a reinforcement learning strategy for deriving the optimal combination of constraints of piping supports. Primarily, we suggest applying the Actor-Critic(AC) learning algorithm for this problem, which is a type of reinforcement learning that has recently been in the spotlight for this problem because it can evaluate an action policy directly by the on-policy method inside the AC algorithm. During learning, it traces the correspondence between State and Action and suggests appropriate labeling criteria. We present the suitability and usefulness of the algorithm applied to the pipe stress analysis procedure through comparative verification between the results derived from the well-trained AC model and the results accomplished by engineers.


    Access

    Download


    Export, share and cite



    Title :

    Actor-Critic reinforcement learning for optimal design of piping support constraint combinations


    Contributors:
    Jong-Ho Ham (author) / Jung-Eun An (author) / Hee-Sung Lee (author) / Gun-il Park (author) / Dong-Yeon Lee (author)


    Publication date :

    2022




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown





    Actor-Critic Reinforcement Learning for Control With Stability Guarantee

    Han, M / Zhang, L / Wang, J et al. | BASE | 2020

    Free access

    A developmental actor-critic reinforcement learning approach for task-nonspecific robot

    Li, Xiaoan / Yang, Yuan / Sun, Yunming et al. | IEEE | 2016



    Merkmalsextraktor für ein neuronales Netzwerk für Actor-Critic-Reinforcement-Learning-Modelle

    EVANS JARED / THOMPSON JEFFREY KEATING / KROENER CHRISTOPH | European Patent Office | 2024

    Free access