This article belongs to the Special Issue Applied Intelligent Control and Perception in Robotics and Automation. ; The inspection of Personal Protective Equipment (PPE) is one of the most necessary measures when treating patients affected by infectious diseases, such as Ebola or COVID-19. Assuring the integrity of health personnel in contact with infected patients has become an important concern in developed countries. This work focuses on the study of Reinforcement Learning (RL) techniques for controlling a scanner prototype in the presence of blood traces on the PPE that could arise after contact with pathological patients. A preliminary study on the design of an agent-environment system able to simulate the required task is presented. The task has been adapted to an environment for the OpenAI Gym toolkit. The evaluation of the agent’s performance has considered the effects of different topological designs and tuning hyperparameters of the Q-Learning model-free algorithm. Results have been evaluated on the basis of average reward and timesteps per episode. The sample-average method applied to the learning rate parameter, as well as a specific epsilon decaying method worked best for the trained agents. The obtained results report promising outcomes of an inspection system able to center and magnify contaminants in the real scanner system. ; The research leading to these results received funding from: Inspección robotizada de los trajes de protección del personal sanitario de pacientes en aislamiento de alto nivel, incluido el ébola, Programa Explora Ciencia, Ministerio de Ciencia, Innovación y Universidades (DPI2015-72015-EXP); the RoboCity2030-DIH-CM Madrid Robotics Digital Innovation Hub ("Robótica aplicada a la mejora de la calidad de vida de los ciudadanos. fase IV"; S2018/NMT-4331), funded by "Programas de Actividades I+D en la Comunidad de Madrid" and cofunded by Structural Funds of the EU; and ROBOESPAS: Active rehabilitation of patients with upper limb spasticity using collaborative robots, Ministerio de Economía, Industria y Competitividad, Programa Estatal de I+D+i Orientada a los Retos de la Sociedad (DPI2017-87562-C2-1-R).


    Access

    Download


    Export, share and cite



    Title :

    Design of an Active Vision System for High-Level Isolation Units through Q-Learning



    Publication date :

    2020-09-01


    Remarks:

    AR/0000027483



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    Learning Low-Level Vision

    Freeman, W. T. / Pasztor, E. C. / Carmichael, O. T. | British Library Online Contents | 2000


    Active Vibration Isolation System

    KNOX LAWRENCE D | European Patent Office | 2018

    Free access

    ACTIVE VIBRATION ISOLATION SYSTEM

    HEVERLY DAVID E II / LEE TAEOH | European Patent Office | 2016

    Free access

    ACTIVE VIBRATION ISOLATION SYSTEM

    KNOX LAWRENCE | European Patent Office | 2018

    Free access

    Binocular Active Vision System

    Dias, J. / Araujo, H. / Simplicio, C. et al. | British Library Conference Proceedings | 1993