Monte Carlo based methods have brought a remarkable improvement in performance of artificial intelligence in the realm of games in recent years, whereby human champions could be beaten in several board games of high complexity. In this work, two Monte Carlo based approaches, the Monte Carlo Search and the Monte Carlo Tree Search, are applied to the game of Connect Four. To test and compare these two approaches, games against each other are simulated. The better approach is then further placed against human opponents using a website (https://carloconnect.com/) and a robotic arm to evaluate the algorithm’s strength. All tests are conducted on a Raspberry Pi 3 Model B to investigate the approaches’ performance in an environment with limited available computing power and memory. The Experiments show that under these conditions the Monte Carlo tree search significantly outperforms the Monte Carlo search and is therefore the better solution. This approach is called CarloConnect and proves itself against human opponents by winning most of the games, thus playing at human level even while having only low computing resources.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Applying Monte Carlo Search and Monte Carlo Tree Search on Embedded Systems to Play Connect Four with a Robotic Arm


    Additional title:

    Mechan. Machine Science



    Conference:

    International Conference on Robotics in Alpe-Adria Danube Region ; 2022 ; Klagenfurt, Austria June 08, 2022 - June 10, 2022



    Publication date :

    2022-04-23


    Size :

    8 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Applying Monte Carlo Search and Monte Carlo Tree Search on Embedded Systems to Play Connect Four with a Robotic Arm

    Vogt, Moritz Duarte Pinheiro-Torres / Fischer, Jörn / Ihme, Thomas | TIBKAT | 2022


    Monte Carlo Tree Search Methods for Telescope Tasking

    Fedeler, Samuel / Holzinger, Marcus | AIAA | 2020


    The Multiple Uses of Monte-Carlo Tree Search

    Senington, Richard | BASE | 2022

    Free access

    MONTE CARLO TREE SEARCH METHODS FOR TELESCOPE TASKING

    Fedeler, Samuel / Holzinger, Marcus | TIBKAT | 2020


    Applications of Monte-Carlo Tree Search in Software Engineering

    Fajardo-Sondon, Luis Rodrigo / Sanchez-Garcia, Angel J. / Cortes-Verdin, Karen et al. | IEEE | 2022