We introduce a dual-hormone control algorithm for people with Type 1 Diabetes (T1D) which uses deep reinforcement learning (RL). Specifically, double dilated recurrent neural networks are used to learn the control strategy, trained by a variant of Q-learning. The inputs to the model include the real-time sensed glucose and meal carbohydrate content, and the outputs are the actions necessary to deliver dual-hormone (basal insulin and glucagon) control. Without prior knowledge of the glucose-insulin metabolism, we develop a data-driven model using the UVA/Padova Simulator. We first pre-train a generalized model using long-term exploration in an environment with average T1D subject parameters provided by the simulator, then adopt importance sampling to train personalized models for each individual. In-silico, the proposed algorithm largely reduces adverse glycemic events, and achieves time in range, i.e., the percentage of normoglycemia, 93% for the adults and 83% for the adolescents, which outperforms previous approaches significantly. These results indicate that deep RL has great potential to improve the treatment of chronic diseases such as diabetes.


    Access

    Download


    Export, share and cite



    Title :

    Personalized Dual-Hormone Control for Type 1 Diabetes Using Deep Reinforcement Learning



    Publication date :

    2020-01-01


    Remarks:

    In: Shaban-Nejad, A and Michalowski, M and Buckeridge, DL, (eds.) Explainable AI in Healthcare and Medicine. (pp. pp. 45-53). Springer: Cham, Switzerland. (2020)


    Type of media :

    Paper


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629





    An Insulin Bolus Advisor for Type 1 Diabetes Using Deep Reinforcement Learning

    Zhu, T / Li, K / Kuang, L et al. | BASE | 2020

    Free access

    Personalized adaptive cruise system based on deep reinforcement learning and control method thereof

    JIANG SHUNMING / WU PENGPENG | European Patent Office | 2023

    Free access

    Adaptive Traffic Control Using Deep Reinforcement Learning

    N, Dhashyanth / R, Hemchand / R, Priyanga et al. | IEEE | 2024