In smart factories, a variety of automated guided vehicles (AGVs) communicate with cyber-physical systems (CPSs) to autonomously deliver raw materials and workpieces among smart production facilities. In practice, instead of acquiring more costly AGVs to cause congestion in existing working space, most factories develop rule-based and model-based approaches to improve the AGV utilization rate and further the production efficiency. However, these charging strategies require predefined rules or models for estimating the internal information of batteries, so that they lead to huge computational costs and estimation errors. As a consequence, this work creates a Markov decision process problem for real-time charging scheduling of AGVs to fulfill uncertain AGV dispatching requests from the CPS for production lines, in which four bounds for charging heterogeneous AGVs are considered from practical experiences for increasing the AGV utilization rate. This work further improves a feature-based reinforcement learning approach, in which the state and action space can be effectively reduced through approximating the state-value function by five feature functions, including the estimated revenue for improving the utilization time, the total AGV charging cost, the cost of penalizing unfulfilled dispatching requests, the priority of charging newer batteries, and the priority of charging the batteries close to be fully charged, respectively. Experimental results show that the proposed algorithm obtains better benefits than the current practical approach, and improves the AGV utilization rate.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Real-Time Charging Scheduling of Automated Guided Vehicles in Cyber-Physical Smart Factories Using Feature-Based Reinforcement Learning


    Contributors:


    Publication date :

    2023-04-01


    Size :

    2482977 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Efficient and Private Scheduling of Wireless Electric Vehicles Charging Using Reinforcement Learning

    Hossain, Mohammad Belayet / Pokhrel, Shiva Raj / Vu, Hai L. | IEEE | 2023


    A Conflict-Free Routing Method for Automated Guided Vehicles Using Reinforcement Learning

    Chujo, Taichi / Nishida, Kosei / Nishi, Tatsushi | British Library Conference Proceedings | 2020



    DISTRIBUTED WIRELESS CHARGING NETWORK FOR AUTOMATED GUIDED VEHICLES

    YANKOWITZ JOSHUA AARON | European Patent Office | 2024

    Free access