Autonomous vehicle development has benefited from sanctioned competitions dating back to the original 2004 DARPA Grand Challenge. Since these competitions, fully autonomous vehicles have become much closer to significant real-world use with the majority of research focused on reliability, safety and cost reduction. Our research details the recent challenges experienced at the 2017 Self Racing Cars event where a team of international Udacity students worked together over a 6 week period, from team selection to race day. The team’s goal was to provide real-time vehicle control of steering, braking, and throttle through an end-to-end deep neural network. Multiple architectures were tested and used including convolutional neural networks (CNN) and recurrent neural networks (RNN). We began our work by modifying a Udacity driving simulator to collect data and develop training models which we implemented and trained on a laptop GPU. Then, in the two days between car delivery and the start of the competition, a customized neural network using Keras and Tensorflow was developed. The deep learning network algorithm predicted car steering angles using a single front-facing camera. Training and deployment on the vehicle was completed using two GTX 1070s since a cloud GPU computing instance was neither available nor feasible. Using the proposed methods and working within the competition’s strict requirements, we completed several semi-autonomous laps and the team remained competitive. The results of the competition indicated that autonomous vehicle command and control can be achieved in a limited form using a single-camera with a short engineering development timeline. This approach lacks robustness and reliability and therefore, a semantic segmentation network was developed using feature extraction from the YOLOv2 network and the CamVid dataset with a correction for the unbalanced occurrence of the different classes. Currently 31 classes can be reliably detected and classified allowing for a more complex and robust decision making architecture.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Development of an Autonomous Vehicle Control Strategy Using a Single Camera and Deep Neural Networks


    Weitere Titelangaben:

    Sae Technical Papers


    Beteiligte:
    Brown, Aaron (Autor:in) / Navarro, Anthony (Autor:in) / Joerdening, Jendrik (Autor:in) / Khalil, Rana (Autor:in) / Asher, Zachary (Autor:in)

    Kongress:

    WCX World Congress Experience ; 2018



    Erscheinungsdatum :

    2018-04-03




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    Development of an Autonomous Vehicle Control Strategy Using a Single Camera and Deep Neural Networks

    Navarro, Anthony / Joerdening, Jendrik / Khalil, Rana et al. | British Library Conference Proceedings | 2018


    Neural Networks in Autonomous Vehicle Control

    Sinha, P. K. / Hadjiiski, L. M. / Mutib, K. et al. | British Library Conference Proceedings | 1993


    Performing autonomous path navigation using deep neural networks

    SMOLYANSKIY NIKOLAI / KAMENEV ALEXEY / SMITH JEFFREY DAVID et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    PERFORMING AUTONOMOUS PATH NAVIGATION USING DEEP NEURAL NETWORKS

    SMOLYANSKIY NIKOLAI / KAMENEV ALEXEY / SMITH JEFFREY DAVID et al. | Europäisches Patentamt | 2018

    Freier Zugriff

    PERFORMING AUTONOMOUS PATH NAVIGATION USING DEEP NEURAL NETWORKS

    SMOLYANSKIY NIKOLAI / KAMENEV ALEXEY / SMITH JEFFREY DAVID et al. | Europäisches Patentamt | 2020

    Freier Zugriff