In this contribution we want to draw the readers attention to the advantages of controller architectures based on Dynamic Cell Structures (DCS) [5] for learning reactive behaviors of autonomous robots. These include incremental on-line learning, fast output calculation, a flexible integration of different learning rules and a close connection to fuzzy logic. The latter allows for incorporation of prior knowledge and to interpret learning with a DCS as fuzzy rule generation and ad aptation. After successful applications of DCS to tasks involving supervised learning, feedback error learning and incremental category learning, in this article we take reinforcement learning of reactive collision avoidance for an autonomous mobile robot as a further example to demonstrate the validity of our approach. More specifically, we employ a REINFORCE [23] algorithm in combination with an Adaptive Heuristic Critique (AHC) [21] to learn a continuous valued sensory motor mapping for obstacle avoidance with a TRC Labmate from delayed rein forcement. The sensory input consists of eight unprocessed sonar readings, the controller output is the continuous angular and forward velocity of the Labmate. The controller and the AHC are integrated within a single DCS network, and the resulting avoidance behavior of the robot can be analyzed as a set of fuzzy rules, each rule having an additional certainty value.
An Integrated Architecture for Learning of Reactive Behaviors based on Dynamic Cell Structures
1996-01-01
Paper
Electronic Resource
English
Dynamic Crushing Behaviors of Four Kinds of Auxetic Structures
SAE Technical Papers | 2019
|Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
British Library Online Contents | 2015
|Static and dynamic behaviors of smart and aerospace structures
Tema Archive | 2007
|Diagnosis of PEM fuel cell stack dynamic behaviors
Online Contents | 2008
|