Markov games can be effectively used to design controllers for nonlinear systems. The paper presents two novel controller design algorithms by incorporating ideas from gametheory literature that address safety and consistency issues of the 'learned' control strategy. A more widely used approach for controller design is the H∞ optimal control, which suffers from high computational demand and at times, may be infeasible. We generate an optimal control policy for the agent (controller) via a simple Linear Program enabling the controller to learn about the unknown environment. The controller is facing an unknown environment and in our formulation this environment corresponds to the behavior rules of the noise modeled as the opponent. Proposed approaches aim to achieve 'safe-consistent' and 'safe-universally consistent' controller behavior by hybridizing 'min-max', 'fictitious play' and 'cautious fictitious play' approaches drawn from game theory. We empirically evaluate the approaches on a simulated Inverted Pendulum swing-up task and compare its performance against standard Q learning.


    Access

    Download


    Export, share and cite



    Title :

    Hybrid Markov Game Controller Design Algorithms for Nonlinear Systems


    Contributors:
    R. Sharma (author) / M. Gopal (author)

    Publication date :

    2007-12-26


    Remarks:

    oai:zenodo.org:1080682



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    Markov Game Controller Design Algorithms

    Rajneesh Sharma / M. Gopal | BASE | 2007

    Free access

    A game theoretic approach to controller design for hybrid systems

    Tomlin, C.J. / Lygeros, J. / Shankar Sastry, S. | Tema Archive | 2000


    Hybrid systems controller design methodology

    Pluska,M. / Sinclair,D. / Dublin City Univ.,IE | Automotive engineering | 2010


    Hybrid Systems Controller Design Methodology

    Pluska, M. / International Federation of Automobile Engineers' and Technicians' Associations | British Library Conference Proceedings | 2010


    Nonlinear Markov Filter Design for Satellite Communications Systems

    Sefcik, Mary / Manning, Robert / Murawski, Robert et al. | AIAA | 2016