In this paper, we study the training strategies of the critic network in adaptive critic designs. The conventional strategy is always to conduct an internal training cycle for the specified object at each time step based on relative information in two consecutive moments. Whereas, in our work, the mechanism of eligibility traces is adopted for the learning of the cost function or its derivatives. The new learning depends on the current error combined with traces of past events. For the classical single cart-pole balancing problem, we implement our idea with one typical adaptive critic design, i.e. action-dependent heuristic dynamic programming. And comparing results demonstrate our approach with more efficiency in the performances such as learning speed and success rate of learning.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Learning with Eligibility Traces in Adaptive Critic Designs


    Contributors:
    Xu, Jing (author) / Liang, Fu-Ming (author) / Yu, Wen-Sheng (author)


    Publication date :

    2006-12-01


    Size :

    553318 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English





    Ramp metering based on adaptive critic designs

    Jing Xu, / Wen-Sheng Yu, / Fei-Yue Wang, | IEEE | 2006


    Autonomous Micro-helicopter Control Based on Reinforcement Learning with Replacing Eligibility Traces

    Yang, Y.-j. / Cheng, J.-s. / Chen, J.-p. et al. | British Library Online Contents | 2003