Advancements in artificial intelligence are leading researchers to find use cases that were not as straightforward to solve in the past. The use case of simulated autonomous driving has been known as a notoriously difficult task to automate, but advancements in the field of reinforcement learning have made it possible to reach satisfactory results. In this paper, we explore the use of the Unity ML-Agents toolkit to train intelligent agents to navigate a racing track in a simulated environment using RL algorithms. The paper compares the performance of several different RL algorithms and configurations on the task of training kart agents to successfully traverse a racing track and identifies the most effective approach for training kart agents to navigate a racing track and avoid obstacles in that track. The best results, value loss of 0.0013 and a cumulative reward of 0.761, were yielded using the Proximal Policy Optimization algorithm. After successfully choosing a model and algorithm that can traverse the track with ease, different objects were added to the track and another model (which used behavioral cloning as a pre-training option) was trained to avoid such obstacles. The aforementioned model resulted in a value loss of 0.001 and a cumulative reward of 0.068, proving that behavioral cloning can help achieve satisfactory results where the in game agents are able to avoid obstacles more efficiently and complete the track with human-like performance, allowing for a deployment of intelligent agents in racing simulators.


    Access

    Download


    Export, share and cite



    Title :

    Simulated autonomous driving using reinforcement learning: a comparative study on unity’s ML-agents framework


    Contributors:

    Publication date :

    2023-01-01


    Remarks:

    Information, Basel : MDPI, 2023, vol. 14, iss. 5, art. no. 290, p. 1-22 ; ISSN 2078-2489


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    VISION-BASED SAMPLE-EFFICIENT REINFORCEMENT LEARNING FRAMEWORK FOR AUTONOMOUS DRIVING

    CHIANG SU-HUI / LIU MING-CHANG | European Patent Office | 2019

    Free access

    - - VISION-BASED SAMPLE-EFFICIENT REINFORCEMENT LEARNING FRAMEWORK FOR AUTONOMOUS DRIVING

    CHIANG SU HUI / LIU MING CHANG | European Patent Office | 2019

    Free access

    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023


    Autonomous Driving using Deep Reinforcement Learning in Urban Environment

    Hashim Shakil Ansari / Goutam R | BASE | 2019

    Free access