A method includes obtaining image frames from each camera disposed along a vehicle, where each image frame corresponds to a same timestamp. The method further includes constructing a first birds-eye view (BEV) image from each image frame with a first BEV module and constructing a second BEV image from each image frame by Inverse Perspective Mapping (IPM) with a second BEV module. The first BEV module extracts features of an external environment of the vehicle from each image frame, transforms the features to a three-dimensional space, and projects the three-dimensional space onto an overhead two-dimensional plane. Subsequently, a merging module merges the first and second BEV images to produce a hybrid BEV image. Features of an external environment of the vehicle within the hybrid BEV image are detected by a deep learning neural network and the hybrid BEV image is displayed to a user in the vehicle.
HYBRID ARCHITECTURE OF BIRDS-EYE VIEW FEATURES AND PIXELS FOR AUTONOMOUS DRIVING PERCEPTION
10.07.2025
Patent
Elektronische Ressource
Englisch
IPC: | G06V / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen |
Multi-task near-field perception for autonomous driving using surround-view fisheye cameras
TIBKAT | 2021
|