The invention discloses an intelligent visual cabin monitoring method based on multiple cameras and a vehicle, and belongs to the field of automobile intelligent cabins, and the method comprises the steps: obtaining the face information and the head posture of a driver through an IR camera, executing a driver state monitoring strategy according to the face information and the head posture of the driver, and obtaining a judgment result and alarm information, the judgment result and the alarm information are sent to a corresponding module of the whole vehicle; the condition in a cockpit is obtained through the wide-angle camera, a cockpit monitoring strategy is executed according to the condition in the cockpit to obtain the expression of a passenger or the state of an object, and the expression of the passenger or the state of the object is sent to a corresponding module of the whole vehicle. According to the invention, a cabin monitoring technology using a plurality of cameras as sensors is adopted, driver detection, passenger detection and cabin detection can be carried out, behaviors such as distraction and fatigue of a driver which are not beneficial to driving safety can be monitored, whether children, pets, wallets and the like are left in the cabin is checked, and financial loss of the driver is avoided.

    本发明公开了一种基于多摄像头的智能视觉座舱监控方法及车辆,属于汽车智能座舱领域,包括:通过所述IR摄像头获取驾驶员面部信息及头部姿态,根据所述驾驶员面部信息及头部姿态执行驾驶员状态监测策略得到判定结果和报警信息,并将所述判定结果和报警信息发送至整车相应的模块;通过所述广角摄像头获取驾驶舱内情况,根据所述驾驶舱内情况执行座舱监测策略得到乘员表情或物体状态,并将所述人员表情或物体状态发送至整车相应的模块。本发明采用多颗摄像头为传感器进行的舱内监测技术,可进行驾驶员检测、乘员检测、舱内检测,可以实现驾驶员分心、疲劳等不利于驾驶安全的行为监测,检查是否有儿童、宠物、钱包等遗漏在舱内,避免驾驶员财务损失。


    Access

    Download


    Export, share and cite



    Title :

    Intelligent visual cabin monitoring method based on multiple cameras and vehicle


    Additional title:

    一种基于多摄像头的智能视觉座舱监控方法及车辆


    Contributors:
    LIU YUANYUAN (author) / LI JIAQI (author) / TIAN CHUAN (author) / ZHU DANYANG (author) / LI YIJUAN (author) / HU GUANGCHENG (author) / GUO DAXING (author) / XIANG WEI (author)

    Publication date :

    2025-01-28


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / B60Q ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL , Anordnung von Signal- oder Beleuchtungsvorrichtungen, deren Einbau oder Halterung oder deren Schaltkreise bei Fahrzeugen allgemein / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06V



    Multiple in-cabin cameras and lighting sources for driver monitoring

    BALCH THOMAS / STENT SIMON A I / ROSMAN GUY et al. | European Patent Office | 2022

    Free access

    MULTIPLE IN-CABIN CAMERAS AND LIGHTING SOURCES FOR DRIVER MONITORING

    BALCH THOMAS / STENT SIMON A I / ROSMAN GUY et al. | European Patent Office | 2022

    Free access

    Multiple in-cabin cameras and lighting sources for driver monitoring

    BALCH THOMAS / STENT SIMON A I / ROSMAN GUY et al. | European Patent Office | 2023

    Free access

    MULTIPLE IN-CABIN CAMERAS AND LIGHTING SOURCES FOR DRIVER MONITORING

    BALCH THOMAS / STENT SIMON A I / ROSMAN GUY et al. | European Patent Office | 2023

    Free access