A method is provided in an Advanced Driver-Assistance System (ADAS). The method extracts, from an input video stream including a plurality of images using a multi-task Convolutional Neural Network (CNN), shared features across different perception tasks. The perception tasks include object detection and other perception tasks. The method concurrently solves, using the multi-task CNN, the different perception tasks in a single pass by concurrently processing corresponding ones of the shared features by respective different branches of the multi-task CNN to provide a plurality of different perception task outputs. Each respective different branch corresponds to a respective one of the different perception tasks. The method forms a parametric representation of a driving scene as at least one top-view map responsive to the plurality of different perception task outputs. The method controls an operation of the vehicle for collision avoidance responsive to the at least one top-view map indicating an impending collision.


    Access

    Download


    Export, share and cite



    Title :

    Multi-task perception network with applications to scene understanding and advanced driver-assistance system


    Contributors:
    TRAN QUOC-HUY (author) / SCHULTER SAMUEL (author) / VERNAZA PAUL (author) / LIU BUYU (author) / JI PAN (author) / TSAI YI-HSUAN (author) / CHANDRAKER MANMOHAN (author)

    Publication date :

    2022-10-04


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V



    MULTI-TASK PERCEPTION NETWORK WITH APPLICATIONS TO SCENE UNDERSTANDING AND ADVANCED DRIVER-ASSISTANCE SYSTEM

    TRAN QUOC-HUY / SCHULTER SAMUEL / VERNAZA PAUL et al. | European Patent Office | 2020

    Free access

    MULTI-TASK PERCEPTION NETWORK WITH APPLICATIONS TO SCENE UNDERSTANDING AND ADVANCED DRIVER-ASSISTANCE SYSTEM

    TRAN QUOC-HUY / SCHULTER SAMUEL / VERNAZA PAUL et al. | European Patent Office | 2020

    Free access

    Task-dependent scene interpretation in driver assistance

    Michalke, Thomas Paul | Tema Archive | 2010



    Multi-sensor network for full surround perception for advanced driver assistance systems in vehicles

    Schuricht, P. / Cassebaum, O. / Wagner, S. et al. | Tema Archive | 2007