The invention relates to a rearview mirror image generation method and device, vehicle-mounted equipment and a readable storage medium. The method comprises the following steps: acquiring side-view camera image data, rear-view camera image data and rear-side radar point cloud data; inputting the image data and the point cloud data into a pre-trained rearview mirror image generation model, and fusing the image features and the point cloud features of the point cloud data through the rearview mirror image generation model to obtain multi-modal feature data; inputting the multi-modal feature data into an encoder module in a rearview mirror image generation model, obtaining encoding feature data matched with the multi-modal feature data, and performing dimension reduction processing on the encoding feature data to obtain dimension reduction feature data; and inputting the dimension reduction feature data into a decoder module in a rearview mirror image generation model, and decoupling the dimension reduction feature data through the decoder module to generate a rearview mirror image of the target automobile. By adopting the method, the generation efficiency of the rearview mirror image can be improved.

    本申请涉及一种后视镜图像生成方法、装置、车载设备和可读存储介质。所述方法包括:获取侧视相机图像数据、后视相机图像数据以及后侧雷达点云数据;将图像数据以及点云数据输入预先训练的后视镜图像生成模型,通过后视镜图像生成模型对图像特征以及点云数据的点云特征进行融合,得到多模态特征数据;将多模态特征数据输入后视镜图像生成模型中的编码器模块,获取与多模态特征数据相匹配的编码特征数据,并对编码特征数据进行降维处理,得到降维特征数据;将降维特征数据输入后视镜图像生成模型中的解码器模块,通过解码器模块对降维特征数据进行解耦,生成目标汽车的后视镜图像。采用本方法能够提高后视镜图像的生成效率。


    Access

    Download


    Export, share and cite



    Title :

    Rearview mirror image generation method and device, vehicle-mounted equipment and readable storage medium


    Additional title:

    后视镜图像生成方法、装置、车载设备和可读存储介质


    Contributors:
    LEI WENTONG (author) / JIANG YANHONG (author) / SU XINGYI (author)

    Publication date :

    2024-09-13


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V



    Vehicle-mounted electronic rearview mirror equipment and vehicle-mounted electronic rearview mirror system

    SUN HUI / HUANG SHI / ZHOU YIXIANG et al. | European Patent Office | 2020

    Free access

    Vehicle-mounted rearview mirror

    SHAN YUEPING / XIAO NIANTAO / LIN YICHAO et al. | European Patent Office | 2015

    Free access

    Rearview mirror control method, device and equipment and readable storage medium

    XIE BIN / TANG LANTAO / DING WUCHAO et al. | European Patent Office | 2023

    Free access

    Rearview mirror control method and device, electronic equipment and readable storage medium

    LI YANG / SU XINGYI / TANG RUYI et al. | European Patent Office | 2024

    Free access

    Rearview mirror control method and device, vehicle and computer readable storage medium

    GONG DACHANG / LIN SHAN'AN / ZHANG WEI | European Patent Office | 2023

    Free access