While most research and development in social human–robot interaction, including interactions of learners with educational robots, has focused on verbal communication through speech (synthesis and recognition), research on non-verbal signals has just started to gain attention. Non-verbal sounds such as clapping, laughter, and mechanical sounds are often overlooked elements in design and research in social human–robot interaction. This paper presents the design of an educational buzzer quiz game for groups of learners, which is facilitated by the humanoid educational robot Pepper, detecting non-verbal sounds as part of the game-play. The paper describes the scenario and a prototype of a robot-supported buzzer quiz game in classroom settings, outlines the challenges in the real-time detection of a mixture of sounds, and presents the approach to real-time auditory and visual multiple-talker tracking, which has been applied in the buzzer quiz game with the Pepper robot.
Non-verbal Sound Detection by Humanoid Educational Robots in Game-Based Learning. Multiple-Talker Tracking in a Buzzer Quiz Game with the Pepper Robot
Lect. Notes in Networks, Syst.
International Conference on Robotics in Education (RiE) ; 2023 ; Limassol, Cyprus April 19, 2023 - April 21, 2023
2023-10-04
12 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
Non-verbal sound detection , Game-based learning (GBL) , Humanoid robots , Educational robot , Pepper robot , Buzzer games , Technology-enhanced learning (TEL) , Multiple-talker tracking Engineering , Control, Robotics, Mechatronics , Engineering/Technology Education , Computational Intelligence , Robotics
Buzzer output control device and buzzer output control method
Europäisches Patentamt | 2015
|