The present invention relates to a system and a method for displaying augmented reality of an underwater construction robot which combine a screen correcting distortion of an image acquired by a camera installed on a robot being active on the seabed and a screen of a blueprint to display a combined screen as an augmented reality screen. The system for displaying augmented reality of an underwater construction robot comprises: a camera which is installed on a front surface of an underwater construction robot, and acquires an image while moving; a filter to remove noise created underwater in the image acquired by the camera; an object recognition unit to recognize an object including a background in the image from which noise is removed by the filter; a search unit to search for a blueprint corresponding to the object recognized by the object recognition unit to find the blueprint; a matching unit to magnify a scale of the blueprint matched by the search unit to match and align a scale of the object recognized by the object recognition unit; an improving unit to improve quality of an image where the blueprint and the object are superimposed by the matching unit; and a display unit to display the image improved by the improving unit on a virtual reality screen. A screen compensating a refractive index of the image acquired by the camera installed on the robot being active on the seabed and a screen of the blueprint are combined to display a combined screen as an augmented reality screen to easily control the underwater construction robot.

    본 발명은 해저에서 활동하는 로봇에 설치된 카메라에서 획득한 영상의 왜곡을 보정한 화면과 설계도의 화면을 결합하여 이를 증강현실 화면으로 표시하는 수중건설 로봇의 증강현실 표시 시스템 및 표시 방법에 관한 것으서, 수중건설로봇의 전면에 설치되고 이동하면서 전면의 영상을 획득하는 카메라; 상기 카메라가 획득한 영상에서 수중에서 발생한 노이즈를 제거하는 필터; 상기 필터에 의해 노이즈가 제거된 영상에서 배경을 포함하는 객체를 인지하는 객체인식부; 상기 객체인식부에 의해 인지된 객체와 대응하는 설계도를 검색하여 찾는 검색부; 상기 검색부에 의해 매칭된 설계도의 비율을 확대하여 상기 객체인식부에 의해 인지된 객체의 비율을 일치시키고 대응시키는 매칭부; 상기 매칭부에 의해 설계도와 객체가 겹쳐진 영상의 화질을 개선시키는 개선부; 및 상기 개선부에 의해 개선된 영상을 가상현실 화면으로 표시하는 표시부;를 포함하여 구성되어 해저에서 활동하는 로봇에 설치된 카메라에서 획득한 영상의 굴절률을 보상한 화면과 설계도의 화면을 결합하여 이를 증강현실 화면으로 표시하여 수중건설로봇을 보다 용이하게 조절할 수 있는 효과가 있다.


    Access

    Download


    Export, share and cite



    Title :

    SYSTEM AND METHOD FOR DISPLAYING AUGMENTED REALITY OF VIEW OF UNDERWATER CONSTRUCTION ROBOT


    Additional title:

    수중건설 로봇의 증강현실 표시 시스템 및 표시 방법


    Contributors:
    KIM KI HUN (author) / LEE CHONG MOO (author)

    Publication date :

    2018-07-04


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Korean


    Classification :

    IPC:    G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / B63C LAUNCHING, HAULING-OUT, OR DRY-DOCKING OF VESSELS , Zuwasserlassen, Trockenstellen, Docken oder Bergen von Schiffen / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen



    Augmented reality information displaying device and augmented reality information displaying method

    SODA TOMOFUMI / IINO MASAHIRO / YAMAMOTO CHIHARU et al. | European Patent Office | 2018

    Free access

    AUGMENTED REALITY INFORMATION DISPLAYING DEVICE AND AUGMENTED REALITY INFORMATION DISPLAYING METHOD

    SODA TOMOFUMI / IINO MASAHIRO / YAMAMOTO CHIHARU et al. | European Patent Office | 2017

    Free access

    METHOD FOR DISPLAYING LABEL IN AUGMENTED REALITY SERVICE

    OH JAE YONG / PARK SE KIL / KIM SUN YOUNG | European Patent Office | 2016

    Free access

    Method For Displaying Augmented Reality Information In Vehicles

    HABERJAHN MATHIAS | European Patent Office | 2023

    Free access

    METHOD, DEVICE AND SYSTEM FOR DISPLAYING AUGMENTED REALITY NAVIGATION INFORMATION

    DOEMLING MAXIMILIAN / XU TAO | European Patent Office | 2021

    Free access