Monte Carlo based methods have brought a remarkable improvement in performance of artificial intelligence in the realm of games in recent years, whereby human champions could be beaten in several board games of high complexity. In this work, two Monte Carlo based approaches, the Monte Carlo Search and the Monte Carlo Tree Search, are applied to the game of Connect Four. To test and compare these two approaches, games against each other are simulated. The better approach is then further placed against human opponents using a website (https://carloconnect.com/) and a robotic arm to evaluate the algorithm’s strength. All tests are conducted on a Raspberry Pi 3 Model B to investigate the approaches’ performance in an environment with limited available computing power and memory. The Experiments show that under these conditions the Monte Carlo tree search significantly outperforms the Monte Carlo search and is therefore the better solution. This approach is called CarloConnect and proves itself against human opponents by winning most of the games, thus playing at human level even while having only low computing resources.
Applying Monte Carlo Search and Monte Carlo Tree Search on Embedded Systems to Play Connect Four with a Robotic Arm
Mechan. Machine Science
International Conference on Robotics in Alpe-Adria Danube Region ; 2022 ; Klagenfurt, Austria June 08, 2022 - June 10, 2022
2022-04-23
8 pages
Article/Chapter (Book)
Electronic Resource
English
Monte Carlo Tree Search Methods for Telescope Tasking
AIAA | 2020
|MONTE CARLO TREE SEARCH METHODS FOR TELESCOPE TASKING
TIBKAT | 2020
|