Systems and techniques for scene classification and prediction is provided herein. A first series of image frames of an environment from a moving vehicle may be captured. Traffic participants within the environment may be identified and masked based on a first convolutional neural network (CNN). Temporal classification may be performed to generate a series of image frames associated with temporal predictions based on a scene classification model based on CNNs and a long short-term memory (LSTM) network. Additionally, scene classification may occur based on global average pooling. Feature vectors may be generated based on different series of image frames and a fusion feature vector may be obtained by performing data fusion based on a first feature vector, a second feature vector, a third feature vector, etc. In this way, a behavior predictor may generate a predicted driver behavior based on the fusion feature.


    Access

    Download


    Export, share and cite



    Title :

    Scene classification prediction


    Contributors:

    Publication date :

    2021-06-15


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06K Erkennen von Daten , RECOGNITION OF DATA / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL



    SCENE CLASSIFICATION PREDICTION

    LAKSHMI NARAYANAN ATHMANARAYANAN / DWIVEDI ISHT / DARIUSH BEHZAD | European Patent Office | 2020

    Free access

    SCENE CLASSIFICATION

    ATHMANARAYANAN LAKSHMI NARAYANAN / ISHT DWIVEDI / BEHZAD DARIUSH | European Patent Office | 2020

    Free access

    DANGEROUS SCENE PREDICTION DEVICE, DANGEROUS SCENE PREDICTION METHOD, AND DANGEROUS SCENE PREDICTION PROGRAM

    FUTATSUGI YASUNORI / MISHIMA YOSHIHIRO / FUKUZATO ATSUSHI et al. | European Patent Office | 2022

    Free access

    DANGEROUS SCENE PREDICTION DEVICE, DANGEROUS SCENE PREDICTION METHOD, AND DANGEROUS SCENE PREDICTION PROGRAM

    FUTATSUGI YASUNORI / MISHIMA YOSHIHIRO / FUKUZATO ATSUSHI et al. | European Patent Office | 2020

    Free access

    Scene Classification Via pLSA

    Bosch, A. / Zisserman, A. / Munoz, X. | British Library Conference Proceedings | 2006