Recent advancements in reinforcement learning algorithms have accelerated the development of control models with high-dimensional inputs and outputs that can reproduce human movement. However, the produced motion tends to be less human-like if algorithms do not involve a biomechanical human model that accounts for skeletal and muscle-tendon properties and geometry. In this study, we have integrated a reinforcement learning algorithm and a musculoskeletal model including trunk, pelvis, and leg segments to develop control modes that drive the model to walk. We simulated human walking first without imposing target walking speed, in which the model was allowed to settle on a stable walking speed itself. A range of other speeds were imposed for the simulation based on the previous self-developed walking speed. All simulations were generated by solving the Markov decision process problem with covariance matrix adaptation evolution strategy, without any reference motion data. We finally demonstrated that our reinforcement learning framework also has the potential to model and predict pathological gait that can result from muscle weakness. ; QC 20211110


    Access

    Download


    Export, share and cite



    Title :

    Simulating Human Walking: A Model-BasedReinforcement Learning Approach with musculoskeletal Modelling


    Contributors:

    Type of media :

    Paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Human walking simulating mechanical leg

    BU WANGHUI / ZHU CHANGDE / DENG RUOYU et al. | European Patent Office | 2021

    Free access

    Human walking simulating mechanical leg

    WANG JUN | European Patent Office | 2022

    Free access

    Human walking simulating mechanical leg

    WANG JUN | European Patent Office | 2022

    Free access

    Human walking simulating mechanical leg

    BU WANGHUI / ZHU CHANGDE / DENG RUOYU et al. | European Patent Office | 2021

    Free access

    Musculoskeletal human-spacesuit interaction model

    Diaz, Ana / Newman, Dava | IEEE | 2014