Systems and methods are disclosed herein for implementation of a vehicle command operation system that may use multi-modal technology to authenticate an occupant of the vehicle to authorize a command and receive natural language commands for vehicular operations. The system may utilize sensors to receive data indicative of a voice command from an occupant of the vehicle. The system may receive second sensor data to aid in the determination of the corresponding vehicular operation in response to the received command. The system may retrieve authentication data for the occupants of the vehicle. The system authenticates the occupant to authorize a vehicular operation command using a neural network based on at least one of the first sensor data, the second sensor data, and the authentication data. Responsive to the authentication, the system may authorize the operation to be performed in the vehicle based on the vehicular operation command.


    Access

    Download


    Export, share and cite



    Title :

    SYSTEMS AND METHODS FOR PERFORMING COMMANDS IN A VEHICLE USING SPEECH AND IMAGE RECOGNITION


    Contributors:

    Publication date :

    2023-03-30


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / G05B Steuer- oder Regelsysteme allgemein , CONTROL OR REGULATING SYSTEMS IN GENERAL / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS



    Systems and methods for performing commands in a vehicle using speech and image recognition

    BHATTACHARYA SUMIT / ROCHE JASON CONRAD / AVADHANAM NIRANJAN | European Patent Office | 2023

    Free access

    SYSTEMS AND METHODS FOR PERFORMING COMMANDS IN A VEHICLE USING SPEECH AND IMAGE RECOGNITION

    BHATTACHARYA SUMIT / ROCHE JASON CONRAD / AVADHANAM NIRANJAN | European Patent Office | 2021

    Free access

    SYSTEMS AND METHODS FOR PERFORMING COMMANDS IN A VEHICLE USING SPEECH AND IMAGE RECOGNITION

    BHATTACHARYA SUMIT / ROCHE JASON / AVADHANAM NIRANJAN | European Patent Office | 2021

    Free access

    SPEECH RECOGNITION FOR VEHICLE VOICE COMMANDS

    RANGARAJAN RANJANI / HUBER JOHN EDWARD / BUSCH LEAH N et al. | European Patent Office | 2020

    Free access

    Speech recognition for vehicle voice commands

    RANGARAJAN RANJANI / HUBER JOHN EDWARD / BUSCH LEAH N et al. | European Patent Office | 2021

    Free access