The present invention relates to a method for detecting and warning of an abnormal condition of a driver of a vehicle based on deep learning. The method includes: a step (a) of allowing a driver condition detection apparatus to input an interior image of the vehicle into a drowsiness detection network to detect a facial part of the specific driver, detect an eye part from the facial part, and detect a blinking condition of eyes to determine a drowsiness condition, and to input the interior image into a pose matching network to detect a body key point of the driver and determine whether the body key point is matched with one of preset driving poses, thereby determining the abnormal condition; and a step (b) of allowing the driver condition detection apparatus, if the driver is determined to have a dangerous condition in reference to a part of the drowsiness condition and the abnormal condition, to transmit information about the dangerous condition to neighboring vehicles through vehicle-to-vehicle (V2V) communication to enable the neighboring vehicles to recognize the dangerous condition. According to the present invention, it is possible to effectively detect a drowsiness condition and an abnormal condition of a certain driver.

    본 발명은 딥러닝에 기반한 차량의 운전자의 이상 상태를 검출하여 경고하는 방법으로서, 운전자 상태 검출 장치가, (a) 상기 차량의 실내 이미지를 졸음 검출 네트워크에 입력하여, 상기 특정 운전자의 얼굴 부분을 검출하고, 상기 얼굴 부분에서 눈 부분을 검출하며, 눈의 깜박거림 상태를 검출하여 졸음 상태를 판단하고, 상기 실내 이미지를 포즈 매칭 네트워크에 입력하여, 상기 운전자의 바디 키포인트(body keypoint)를 검출하도록 하고, 상기 바디 키포인트가 기설정된 주행 포즈 중 하나와 매칭하는지를 판단하도록 함으로써, 상기 이상 상태를 판단하는 단계; 및 (b) 상기 졸음 상태 및 상기 이상 상태 중 일부를 참조로 하여, 상기 운전자가 위험 상태인 것으로 판단되면, V2V(vehicle-to-vehicle) 통신을 통해, 상기 위험 상태에 관한 정보를 주변 차량에 전송하여 주변 차량으로 하여금 상기 위험 상태를 인식하도록 하는 단계를 포함하는 방법에 관한 것이다.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    V2V METHOD AND DEVICE FOR ALERTING ABNORMAL DRIVER SITUATION DETECTED BY USING HUMANS' STATUS RECOGNITION VIA V2V CONNECTION


    Weitere Titelangaben:

    V2V 연결을 통해 사람의 상태 인식을 활용해 검출된 운전자의 이상 상태를 경고하기 위한 방법 및 장치


    Beteiligte:
    KIM KYE HYEON (Autor:in) / KIM YONG JOONG (Autor:in) / KIM HAK KYOUNG (Autor:in) / NAM WOON HYUN (Autor:in) / BOO SUK HOON (Autor:in) / SUNG MYUNG CHUL (Autor:in) / SHIN DONG SOO (Autor:in) / YEO DONG HUN (Autor:in) / RYU WOO JU (Autor:in) / LEE MYEONG CHUN (Autor:in)

    Erscheinungsdatum :

    2020-08-10


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Koreanisch


    Klassifikation :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR



    METHOD AND DEVICE FOR ALERTING ABNORMAL DRIVER SITUATION DETECTED BY USING HUMANS' STATUS RECOGNITION VIA V2V CONNECTION

    KIM KYE-HYEON / KIM YONGJOONG / KIM HAK-KYOUNG et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    METHOD AND DEVICE FOR ALERTING ABNORMAL DRIVER SITUATION DETECTED BY USING HUMANS' STATUS RECOGNITION VIA V2V CONNECTION

    KIM KYE-HYEON / KIM YONGJOONG / KIM HAK-KYOUNG et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    METHOD AND DEVICE FOR ALERTING ABNORMAL DRIVER SITUATION DETECTED BY USING HUMANS' STATUS RECOGNITION VIA V2V CONNECTION

    KIM KYE-HYEON / KIM YONGJOONG / KIM HAK-KYOUNG et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    Method and device for alerting abnormal driver situation detected by using humans' status recognition via V2V connection

    KIM KYE-HYEON / KIM YONGJOONG / KIM HAK-KYOUNG et al. | Europäisches Patentamt | 2020

    Freier Zugriff