Jornada de Recerca en Automàtica, Visió i Robòtica (AVR), 2004, Barcelona (España) ; An autonomous agent is considered intelligent if it is capable to improve its performance through time, learning by experience. The problem of learning to improve performance from experience has been formalized in the field of Reinforcement Learning. The main difficulty found in this field is that the number of experiences required for learning to take place could be very large depending on the environment structure. If the environment has no structure at all the learning cannot be completed until all actions have been executed at least once in each possible state. Then, the application of reinforcement learning techniques is only fea-sible when the environment presents enough regularity to allow some kind of generalization. Many reinforcement learning techniques have been proposed using different forms of generalization. Despite the diversity of strategies proposed, usual generalization techniques do not take ad-vantage of all the opportunities of generalization. A new algorithm was proposed that exploits a type of regularity that is denoted as categorizability. Categorizability means that from all the relevant features that must be taken into account to decide the best action in any situation, only a few of them are actually relevant in each particular situation. In this paper the categorization and learning capabilities of the algorithm are evaluated using a problem that satisfies to a good extent the categorization property. The categorization achieved is analyzed in detail and illustrated with examples. The algorithm learning performance is compared with those of other learning algorithms. Some improvements of the original algorithm are introduced. ; This work was supported by the project 'Sistema reconfigurable para la navegación basada en visión de robots caminantes y rodantes en entornos naturales.' (00). ; Peer Reviewed


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Applying categorization to improve learning in complex environments


    Beteiligte:

    Erscheinungsdatum :

    2004-01-01


    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Learning in complex environments with feature-based categorization

    Agostini, Alejandro / Celaya, Enric | BASE | 2005

    Freier Zugriff

    Improve scene categorization via sub-scene recognition

    Zhu, S. s. / Yung, N. H. | British Library Online Contents | 2014


    3D object shape categorization in domestic environments

    Mueller, Christian A. | TIBKAT | 2012

    Freier Zugriff

    Learning Compositional Categorization Models

    Ommer, B. / Buhmann, J. M. | British Library Conference Proceedings | 2006


    Learning Compositional Categorization Models

    Ommer, Björn / Buhmann, Joachim M. | Springer Verlag | 2006

    Freier Zugriff