Autonomous vehicles require an accurate and adequate representation of their environment for decision making and planning in real-world driving scenarios. While deep learning methods have come a long way providing accurate semantic segmentation of scenes, they are still limited to pixel-wise outputs and do not naturally support high-level reasoning and planning methods that are required for complex road manoeuvres. In contrast, we introduce a hierarchical, graph-based representation, called scene graph, which is reconstructed from a partial, pixel-wise segmentation of an image, and which can be linked to domain knowledge and AI reasoning techniques. In this work, we use an adapted version of the Earley parser and a learnt probabilistic grammar to generate scene graphs from a set of segmented entities. Scene graphs model the structure of the road using an abstract, logical representation which allows us to link them with background knowledge. As a proof-of-concept we demonstrate how parts of a parsed scene can be inferred and classified beyond labelled examples by using domain knowledge specified in the Highway Code. By generating an interpretable representation of road scenes and linking it to background knowledge, we believe that this approach provides a vital step towards explainable and auditable models for planning and decision making in the context of autonomous driving.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reading between the Lanes: Road Layout Reconstruction from Partially Segmented Scenes


    Contributors:


    Publication date :

    2018-11-01


    Size :

    2965100 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Method of representing road lanes

    WEILAND MICHAEL / NYCZAK GREGORY / MCDONOUGH WILLIAM et al. | European Patent Office | 2017

    Free access

    Method of representing road lanes

    WEILAND MICHAEL / NYCZAK GREGORY / MCDONOUGH WILLIAM et al. | European Patent Office | 2016

    Free access

    Method of representing road lanes

    WEILAND MICHAEL / NYCZAK GREGORY / MCDONOUGH WILLIAM et al. | European Patent Office | 2019

    Free access

    Bi-Level Programming Model for Urban Bus Lanes' Layout

    Chen, Q. / Shi, F. / Yao, J.-l. et al. | British Library Conference Proceedings | 2007


    Adaptative road lanes detection and classification

    Collado, Juan M. / Hilario, Cristina / Escalera, Arturo de la et al. | Tema Archive | 2006