Humans assimilate information from the traffic environment mainly through visual perception. Obviously, the dominant information required to conduct a vehicle can be acquired with visual sensors. However, in contrast to most other sensor principles, video signals contain relevant information in a highly indirect manner and hence visual sensing requires sophisticated machine vision and image understanding techniques. This paper provides an overview on the state of research in the field of machine vision for intelligent vehicles. The functional spectrum addressed covers the range from advanced driver assistance systems to autonomous driving. The organization of the article adopts the typical order in image processing pipelines that successively condense the rich information and vast amount of data in video sequences. Data-intensive low-level “early vision” techniques first extract features that are later grouped and further processed to obtain information of direct relevance for vehicle guidance. Recognition and classification schemes allow to identify specific objects in a traffic scene. Recently, semantic labeling techniques using convolutional neural networks have achieved impressive results in this field. High-level decisions of intelligent vehicles are often influenced by map data. The emerging role of machine vision in the mapping and localization process is illustrated at the example of autonomous driving. Scene representation methods are discussed that organize the information from all sensors and data sources and thus build the interface between perception and planning. Recently, vision benchmarks have been tailored to various tasks in traffic scene perception that provide a metric for the rich diversity of machine vision methods. Finally, the paper addresses computing architectures suited to real-time implementation. Throughout the paper, numerous specific examples and real world experiments with prototype vehicles are presented.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    The Role of Machine Vision for Intelligent Vehicles


    Contributors:

    Published in:

    Publication date :

    2016-03-01


    Size :

    681179 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    The Role of Vision Sensors in Future Intelligent Vehicles

    Yen, Huan / Humm, Lawrence / Hamilton, Lisa et al. | SAE Technical Papers | 2001


    The role of vision sensors in future intelligent vehicles

    Hamilton, L. / Humm, L. / Daniels, M. et al. | Tema Archive | 2001


    Vision for Intelligent Road Vehicles

    Graefe, V. / IEEE | British Library Conference Proceedings | 1993



    Real time vision for intelligent vehicles

    Gavrila, D.M. / Franke, U. / Wohler, C. et al. | Tema Archive | 2001