Autonomous vehicle development has benefited from sanctioned competitions dating back to the original 2004 DARPA Grand Challenge. Since these competitions, fully autonomous vehicles have become much closer to significant real-world use with the majority of research focused on reliability, safety and cost reduction. Our research details the recent challenges experienced at the 2017 Self Racing Cars event where a team of international Udacity students worked together over a 6 week period, from team selection to race day. The team’s goal was to provide real-time vehicle control of steering, braking, and throttle through an end-to-end deep neural network. Multiple architectures were tested and used including convolutional neural networks (CNN) and recurrent neural networks (RNN). We began our work by modifying a Udacity driving simulator to collect data and develop training models which we implemented and trained on a laptop GPU. Then, in the two days between car delivery and the start of the competition, a customized neural network using Keras and Tensorflow was developed. The deep learning network algorithm predicted car steering angles using a single front-facing camera. Training and deployment on the vehicle was completed using two GTX 1070s since a cloud GPU computing instance was neither available nor feasible. Using the proposed methods and working within the competition’s strict requirements, we completed several semi-autonomous laps and the team remained competitive. The results of the competition indicated that autonomous vehicle command and control can be achieved in a limited form using a single-camera with a short engineering development timeline. This approach lacks robustness and reliability and therefore, a semantic segmentation network was developed using feature extraction from the YOLOv2 network and the CamVid dataset with a correction for the unbalanced occurrence of the different classes. Currently 31 classes can be reliably detected and classified allowing for a more complex and robust decision making architecture.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Development of an Autonomous Vehicle Control Strategy Using a Single Camera and Deep Neural Networks


    Additional title:

    Sae Technical Papers


    Contributors:

    Conference:

    WCX World Congress Experience ; 2018



    Publication date :

    2018-04-03




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Development of an Autonomous Vehicle Control Strategy Using a Single Camera and Deep Neural Networks

    Navarro, Anthony / Joerdening, Jendrik / Khalil, Rana et al. | British Library Conference Proceedings | 2018


    Neural Networks in Autonomous Vehicle Control

    Sinha, P. K. / Hadjiiski, L. M. / Mutib, K. et al. | British Library Conference Proceedings | 1993


    Performing autonomous path navigation using deep neural networks

    SMOLYANSKIY NIKOLAI / KAMENEV ALEXEY / SMITH JEFFREY DAVID et al. | European Patent Office | 2022

    Free access

    PERFORMING AUTONOMOUS PATH NAVIGATION USING DEEP NEURAL NETWORKS

    SMOLYANSKIY NIKOLAI / KAMENEV ALEXEY / SMITH JEFFREY DAVID et al. | European Patent Office | 2018

    Free access

    PERFORMING AUTONOMOUS PATH NAVIGATION USING DEEP NEURAL NETWORKS

    SMOLYANSKIY NIKOLAI / KAMENEV ALEXEY / SMITH JEFFREY DAVID et al. | European Patent Office | 2020

    Free access