The invention relates to a virtual image interaction realization method and system based on intelligent cabin AR, and belongs to the technical field of intelligent cabin AR. Firstly, whether the current state is a parking state needs to be judged through a vehicle body signal, so that the use safety of a user is guaranteed; the current connection state is judged through an MIC and a camera sensor, a user needs to start VR wake-free to ensure that the user can communicate with the VR of the vehicle-mounted terminal in a non-inductive mode, user audio data are transmitted to the vehicle-mounted terminal through the MIC, and the received audio data are processed through a VR engine and output and fed back through a sound box; the vehicle machine system splices and synthesizes the video image data and the virtual image collected by the camera in the vehicle by using an image splicing algorithm, and then transmits the video image data and the virtual image to the AR glasses through H.264 coding compression, so that a user does not communicate with the virtual image on a screen any more; and the virtual image and the real scene in the vehicle are naturally fused, so that the VR experience of the virtual image in the vehicle of the user is improved.

    本发明涉及一种基于智能座舱AR虚拟形象交互实现的方法及系统,属于智能座舱AR技术领域;本发明首先需要通过车身信号判断当前是否为驻车状态,以保障用户使用安全;再通过MIC和摄像头传感器判断当前连接状态,用户需要开启VR免唤醒以保障用户和车机VR可以无感交流,用户音频数据经MIC传到车机把收到的音频数据通过VR引擎处理并通过音响输出反馈;车机系统将车内摄像头采集到的视频图象数据和虚拟形象利用图象拼接算法进行拼接合成,然后再通过H.264编码压缩传输给AR眼镜,从而本发明可以让用户不再和屏幕上的虚拟形象进行沟通交流,而是打造虚拟影像与现实车内实景的自然交融,提升用户车内虚拟形象VR体验。


    Access

    Download


    Export, share and cite



    Title :

    Method and system for realizing AR virtual image interaction based on intelligent cabin


    Additional title:

    一种基于智能座舱AR虚拟形象交互实现的方法及系统


    Contributors:
    LYU DANPING (author) / ZENG JUN (author) / CUI YONG (author)

    Publication date :

    2022-06-24


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    A63F CARD, BOARD OR ROULETTE GAMES , Kartenspiele, Brettspiele, Roulettespiele / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Method for realizing firework show in intelligent cabin and intelligent cabin

    XU LU / LU KE / ZHOU YU | European Patent Office | 2023

    Free access

    Intelligent cabin system based on multimode interaction and virtual reality technology

    ZHAO JINGYU / ZHANG XUNFANG | European Patent Office | 2022

    Free access

    Automobile intelligent cabin system and interaction method

    YANG WEIFENG / CHEN PENG | European Patent Office | 2023

    Free access

    Information interaction method in intelligent vehicle cabin and intelligent vehicle cabin

    ZHANG YIJIA / WANG WEIWEI / LIU YUQI | European Patent Office | 2023

    Free access

    Cabin system for realizing SOA architecture based on ROS2 and operation method of the cabin system

    WANG WANG / ZOU XIAODONG / WANG GANG | European Patent Office | 2021

    Free access