The Industrial IoT era has benefitted immensely from increased data collection and processing, which enables Industry 4.0 and predictive maintenance. Predictive maintenance tries to predict when different types of failures will occur. Prescriptive maintenance goes further by optimizing the maintenance decisions, i.e. what to do and when to do it. This paper considers a distributed factory environment, and firstly, proposes a model-based approach to prescriptive maintenance using the Partially Observable Markov Decision Process (POMDP) framework. A particle filter algorithm performs online estimation of a POMDP model to enable it to adapt to each machine over time. The POMDP is then solved using the point based value iteration (PBVI) method to obtain maintenance decisions. Next, we present a model-free approach to prescriptive maintenance using the Deep Q-Network (DQN) reinforcement learning method to obtain maintenance decisions. The POMDP and DQN methods are implemented on GPU-accelerated edge computing nodes and their performance in terms of reward and downtime are compared.
Model-based and Model-free Prescriptive Maintenance on Edge Computing Nodes
2023-06-01
4306116 byte
Conference paper
Electronic Resource
English
Prescriptive Analytics for Dynamic Risk-Based Naval Vessel Maintenance Decision-Making
Springer Verlag | 2024
|FOR-DEC: a prescriptive model for aeronautical decision making
British Library Conference Proceedings | 1995
|Cooperative vehicle afflux method based on edge computing nodes
European Patent Office | 2023
|