When robots share the same workspace with other intelligent agents (e.g., other robots or humans), they must be able to reason about the behaviors of their neighboring agents while accomplishing the designated tasks. In practice, frequently, agents do not exhibit absolutely rational behavior due to their limited computational resources. Thus, predicting the optimal agent behaviors is undesirable (because it demands prohibitive computational resources) and undesirable (because the prediction may be wrong). Motivated by this observation, we remove the assumption of perfectly rational agents and propose incorporating the concept of bounded rationality from an information-theoretic view into the game-theoretic framework. This allows the robots to reason other agents’ sub-optimal behaviors and act accordingly under their computational constraints. Specifically, bounded rationality directly models the agent’s information processing ability, which is represented as the KL-divergence between nominal and optimized stochastic policies, and the solution to the bounded-optimal policy can be obtained by an efficient importance sampling approach. Using both simulated and real-world experiments in multi-robot navigation tasks, we demonstrate that the resulting framework allows the robots to reason about different levels of rational behaviors of other agents and compute a reasonable strategy under its computational constraint. ( 1 \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{1}$$\end{document}A preliminary version of this work appeared as a poster in 2021 NeurIPS Workshop on Learning and Decision-Making with Strategic Feedback.

    The video of the real-world experiments can be found at https://youtu.be/hzCitSSuWiI.

    We gratefully acknowledge the support of NSF with grant No. 2006886 and 2047169.)


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Decision-Making Among Bounded Rational Agents


    Additional title:

    Springer Proceedings in Advanced Robotics


    Contributors:

    Conference:

    International Symposium on Distributed Autonomous Robotic Systems ; 2022 ; Montbéliard, France November 28, 2022 - November 30, 2022



    Publication date :

    2024-02-01


    Size :

    13 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English





    Procedurally Rational Decision-Making and Control

    Stirling, W. C. / Goodrich, M. A. / Frost, R. L. | British Library Online Contents | 1996


    Bounded awareness: Implications for ethical decision making

    Bazerman, Max H | Online Contents | 2016


    Bounded rational choice behaviour : applications in transport

    Rasouli, Soora ;Timmermans, Harry J. P. | TIBKAT | 2015


    Bounded rational choice behaviour : applications in transport

    Rasouli, Soora ;Timmermans, Harry J. P. | SLUB | 2015