Successful goal-directed navigation requires learning to accurately estimate location and select optimal actions in each location. Midbrain dopamine neurons are known to be involved in reward value learning, and have also been linked to reward location learning. Dopamine neurons are therefore ideally placed to provide teaching signals for goal-directed navigation. To test this, we imaged dopamine neural activity as mice learned to navigate in a closed-loop virtual reality corridor and lick to report the reward location. Across learning, phasic dopamine responses developed that resembled reward prediction errors and indicated the animal’s estimate of the reward location. We also observed the development of pre-reward ramping activity, the slope of which was modulated by both learning stage and task engagement. We devised a Q-learning model incorporating subjective position inference and an eligibility trace which recapitulated our behavioural and physiological findings. The model further predicted a teaching effect of the ramp in improving task performance, which we also found in our experimental data, indicating that the ramp played a teaching role in the selection of accurate location-specific action during navigation. Our results indicate that midbrain dopamine neurons, through both their phasic and ramping activity, encode reward prediction error to provide teaching signals for improving goal-directed navigation.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    The role of midbrain dopaminergic neurons in goal-directed navigation


    Beteiligte:

    Erscheinungsdatum :

    2022-05-28


    Anmerkungen:

    Doctoral thesis, UCL (University College London).


    Medientyp :

    Hochschulschrift


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629



    Midbrain dopamine neurons signal phasic and ramping reward prediction error during goal-directed navigation

    Farrell, Karolina / Lak, Armin / Saleem, Aman B | BASE | 2022

    Freier Zugriff

    Biologically inspired goal directed navigation for mobile robots

    Amayo, Paul Omondi | BASE | 2016

    Freier Zugriff

    DeFINE:delayed feedback-based immersive navigation environment for studying goal-directed human navigation

    Kyrki, V. (Ville) / Cheung, A. (Allen) / Yamamoto, N. (Naohide) | BASE | 2021

    Freier Zugriff


    METHODS AND SYSTEMS FOR SHARED CONTROL OF GOAL DIRECTED WHEELCHAIR NAVIGATION

    ANG WEI TECH / GARG NEHA PRIYADARSHINI / LEI ZHEN et al. | Europäisches Patentamt | 2022

    Freier Zugriff