In smart factories, a variety of automated guided vehicles (AGVs) communicate with cyber-physical systems (CPSs) to autonomously deliver raw materials and workpieces among smart production facilities. In practice, instead of acquiring more costly AGVs to cause congestion in existing working space, most factories develop rule-based and model-based approaches to improve the AGV utilization rate and further the production efficiency. However, these charging strategies require predefined rules or models for estimating the internal information of batteries, so that they lead to huge computational costs and estimation errors. As a consequence, this work creates a Markov decision process problem for real-time charging scheduling of AGVs to fulfill uncertain AGV dispatching requests from the CPS for production lines, in which four bounds for charging heterogeneous AGVs are considered from practical experiences for increasing the AGV utilization rate. This work further improves a feature-based reinforcement learning approach, in which the state and action space can be effectively reduced through approximating the state-value function by five feature functions, including the estimated revenue for improving the utilization time, the total AGV charging cost, the cost of penalizing unfulfilled dispatching requests, the priority of charging newer batteries, and the priority of charging the batteries close to be fully charged, respectively. Experimental results show that the proposed algorithm obtains better benefits than the current practical approach, and improves the AGV utilization rate.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Real-Time Charging Scheduling of Automated Guided Vehicles in Cyber-Physical Smart Factories Using Feature-Based Reinforcement Learning


    Beteiligte:
    Lin, Chun-Cheng (Autor:in) / Chen, Kun-Yang (Autor:in) / Hsieh, Li-Tsung (Autor:in)


    Erscheinungsdatum :

    01.04.2023


    Format / Umfang :

    2482977 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Efficient and Private Scheduling of Wireless Electric Vehicles Charging Using Reinforcement Learning

    Hossain, Mohammad Belayet / Pokhrel, Shiva Raj / Vu, Hai L. | IEEE | 2023



    A Conflict-Free Routing Method for Automated Guided Vehicles Using Reinforcement Learning

    Chujo, Taichi / Nishida, Kosei / Nishi, Tatsushi | British Library Conference Proceedings | 2020


    DISTRIBUTED WIRELESS CHARGING NETWORK FOR AUTOMATED GUIDED VEHICLES

    YANKOWITZ JOSHUA AARON | Europäisches Patentamt | 2024

    Freier Zugriff