The invention relates to a virtual image interaction realization method and system based on intelligent cabin AR, and belongs to the technical field of intelligent cabin AR. Firstly, whether the current state is a parking state needs to be judged through a vehicle body signal, so that the use safety of a user is guaranteed; the current connection state is judged through an MIC and a camera sensor, a user needs to start VR wake-free to ensure that the user can communicate with the VR of the vehicle-mounted terminal in a non-inductive mode, user audio data are transmitted to the vehicle-mounted terminal through the MIC, and the received audio data are processed through a VR engine and output and fed back through a sound box; the vehicle machine system splices and synthesizes the video image data and the virtual image collected by the camera in the vehicle by using an image splicing algorithm, and then transmits the video image data and the virtual image to the AR glasses through H.264 coding compression, so that a user does not communicate with the virtual image on a screen any more; and the virtual image and the real scene in the vehicle are naturally fused, so that the VR experience of the virtual image in the vehicle of the user is improved.
本发明涉及一种基于智能座舱AR虚拟形象交互实现的方法及系统,属于智能座舱AR技术领域;本发明首先需要通过车身信号判断当前是否为驻车状态,以保障用户使用安全;再通过MIC和摄像头传感器判断当前连接状态,用户需要开启VR免唤醒以保障用户和车机VR可以无感交流,用户音频数据经MIC传到车机把收到的音频数据通过VR引擎处理并通过音响输出反馈;车机系统将车内摄像头采集到的视频图象数据和虚拟形象利用图象拼接算法进行拼接合成,然后再通过H.264编码压缩传输给AR眼镜,从而本发明可以让用户不再和屏幕上的虚拟形象进行沟通交流,而是打造虚拟影像与现实车内实景的自然交融,提升用户车内虚拟形象VR体验。
Method and system for realizing AR virtual image interaction based on intelligent cabin
一种基于智能座舱AR虚拟形象交互实现的方法及系统
2022-06-24
Patent
Electronic Resource
Chinese
Method for realizing firework show in intelligent cabin and intelligent cabin
European Patent Office | 2023
|Intelligent cabin system based on multimode interaction and virtual reality technology
European Patent Office | 2022
|Automobile intelligent cabin system and interaction method
European Patent Office | 2023
|Information interaction method in intelligent vehicle cabin and intelligent vehicle cabin
European Patent Office | 2023
|Cabin system for realizing SOA architecture based on ROS2 and operation method of the cabin system
European Patent Office | 2021
|