The subject of self-driving car technology has drawn growing interest in recent years. Many companies, such as Baidu and Tesla, have already introduced automatic driving techniques in their newest cars when driving in a specific area. However, there are still many challenges ahead toward fully autonomous driving cars. Tesla has caused several severe accidents when using autonomous driving functions, which makes the public doubt self-driving car technology. Therefore, it is necessary to use the simulator environment to help verify and perfect algorithms for the perception, planning, and decision-making of autonomous vehicles before implementation in real-world cars. This project aims to build a benchmark for implementing the whole self-driving car system in software. There are three main components including perception, planning, and control in the entire autonomous driving system. This thesis focuses on two sub-tasks 2D object detection and semantic segmentation in the perception part. All of the experiments will be tested in a simulator environment called The CAR Learning to Act(Carla), which is an open-source platform for autonomous car research. Carla simulator is developed based on the game engine(Unreal4). It has a server-client system, which provides a flexible python API. 2D object detection uses the You only look once(Yolov4) algorithm that contains the tricks of the latest deep learning techniques from the aspect of network structure and data augmentation to strengthen the network’s ability to learn the object. Yolov4 achieves higher accuracy and short inference time when comparing with the other popular object detection algorithms. Semantic segmentation uses Efficient networks for Computer Vision(ESPnetv2). It is a light-weight and power-efficient network, which achieves the same performance as other semantic segmentation algorithms by using fewer network parameters and FLOPS. In this project, Yolov4 and ESPnetv2 are implemented into the Carla simulator. Two modules work together to help the autonomous ...


    Access

    Download


    Export, share and cite



    Title :

    2D object detection and semantic segmentation in the Carla simulator ; 2D-objekt detektering och semantisk segmentering i Carla-simulatorn


    Contributors:
    Wang, Chen (author)

    Publication date :

    2020-01-01


    Type of media :

    Theses


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    CARLA+: An Evolution of the CARLA Simulator for Complex Environment Using a Probabilistic Graphical Model

    Sumbal Malik / Manzoor Ahmed Khan / Aadam et al. | DOAJ | 2023

    Free access

    CARLA Simulated Data for Rare Road Object Detection

    Bu, Tom / Zhang, Xinhe / Mertz, Christoph et al. | IEEE | 2021


    ANTI-CARLA: An Adversarial Testing Framework for Autonomous Vehicles in CARLA

    Ramakrishna, Shreyas / Luo, Baiting / Kuhn, Christopher B. et al. | IEEE | 2022


    Autonomous Navigation with Deep Reinforcement Learning in Carla Simulator

    Wang, Peilin / Technische Universität Dresden | SLUB | 2023


    A Waypoint Tracking Controller for Autonomous Vehicles Using CARLA Simulator

    Srinivas, Chinmay / Patil, Sharanbassappa S. | Springer Verlag | 2022